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Foreword 



Health authorities are painfully aware thai our existing knowledge 
about hospital utilization must be greatly expanded if community, regional* 
and national planning is to be truly effective. We have become sophisticated 
enough to recognize, for example, that bed needs should not be established 
primarily on the basis of fixed bed/population ratios. But we have hardly 
begun to grapple with such problems as developing acceptable criteria for 
optimum use, refining data through n-mlti variant analyses and other techniques, 
and determining exactly where the hospital belongs in the overall pattern of 
health facilities. 

To stimulate fresh research in all phases of this complex subject, a 
Conference on Research in Hospital Use was held at the American Hospital 
Association Headquarters in Chicago on January 22-23, 1063, Sponsored 
jointly by the Hospital Research find Educational Trust of the American 
Hospital Association and the U.S. Public Health Service, it brought together 
more than 100 persons representing a broad range of professional disciplines. 
During two full days of formal presentations, panel discussions, and quosfcioii- 
and-answor periods, the participants reviewed recent research, debated 
methodological problems, and explored areas where additional studies aro 
particularly needed. 

While there was general concurrence that further research will be diffi- 
cult, time-consuming, and costly, it was encouraging to note the real progress 
evident in projects now under way. Perhaps the greatest value of the con- 
ference lay in having so many people honestly discuss approaches that had not 
worked and difficulties that must be guarded against in structured research. 

We hope that the summary and Hie detailed conference proceedings will 
be useful to individuals and groups already working in this area, and that 
additional researchers will undertake serious studies of hospital utilization. 
The Public Health Service will give such studies a- high priority in applica- 
tions for grants under its extramural research program. 




HAROLD M. GRAKI 
Assistant Swge 
Division of Hospital <md MediaaZ FaoiMtiea 
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General Summary 



THE CONFERENCE IN REVIEW 



In the last three decades the Nation's ex- 
penditures for health care have risen steadily, both 
in absolute terms and as a proportion of total 
spending. It is generally accepted that increased 
expenditures have been an important factor in 
the unprecedented medical progress achieved dur- 
ing this period and that further increases will be 
necessary if progress is to continue, 

But as both the public and members of the 
health professions see mounting 1 evidence that 
medical progress costs money, they become more 
and more insistent that the money be wisely spent. 
If this is true of medical care in general, it is es- 
pecially true of the component elements of hospital 
care. 

For years hospital costs have risen more 
sharply than overall medical costs partly, though 
not solely, because hospitals have become a steadily 
more important part of the medical-care complex, 
Everyone agrees that hospitals are important} and 
everyone agrees that they must be used efficiently, 
But what constitutes efficient use? This question 
can be answered only by a body of valid research 
data covering all phases of hospital utilization 
bed ratios, architectural design, personnel, quality 
of care as well as such related matters as the non- 
hospital medical facilities available in a commu- 
nity, demographic factors, and the attitudes of 
local population groups on various health ques- 
tions. Authorities freely concede that our present 
body of information in these ai-eas is inadequate. 



Purpose of Conference 

The conference described in these pages rep- 
resents a major effort to assess the current status of 
our research in hospital use, to chart the direction 
future studies should take, and to explore ways oJ! 
making such studies. Despite sub-zero weather in 
Chicago at the time of the sessions, the meeting 
attracted more than 100 persons physicians, eco- 
nomists, hospital and public health leaders, sta- 
tisticians, and others with special interest and ex- 
perience in utilization research. In effect, the par- 
ticipants provided the mullidisoiplined approach 
considered essential for further work in (his area. 

If any reader of this report expects to find 
ready answers to hospital problems, ho will be dis- 
appointed. It was not that kind of meeting, Tho 
discussants wore not dealing directly with the 
phenomenon of hospital use; rather, they were 
taking a searching, self -critical look at their meth- 
ods of examining the phenomenon. 

The importance and complexity of the sub- 
ject were stressed at the outset by Chairman George 
Bugbee, Director of the University of Chicago's 
Health Information Foundation. The question 
of how to use hospitals effectively, he said, is "one 
of the major unresolved issues in the health field. 
. , , The hospital field and physicians have a job of 
either correcting faults or being ablo to defend 
present practices." 



Greater knowledge about hospital use and 
its dimensions is essential, he added, particularly 
to aid in planning 1 acilities and bed requirements. 
Belter information is also needed for policy plan- 
ning in evaluating total national expenditures and 
how they aft'ect action by government. 



Major Problem Areas 

Although we have already learned some 
tilings from research in hospital use, Mr. Bugbee 
said, "there is more that we do not know than has 
so far been answered." He cited three problem 
areas where more work is urgently needed: 

It is known that there are broad varia- 
tions in hospital utilization rates both among our 
own States and between tha experience of the 
United States and that of Canada and countries 
of Western Europe. But thus far there has been 
no real definition of proper use or even any agree- 
ment that such a definition is possible. 

The questions of use and quality of care 
are so interwoven that they are inseparable : "One 
cannot look at hospital \ise without examining 
medical care . . . and, further, the customs of the 
population using the care. . . ." 

We still require research to develop 
methods of studying utilization. Improvements 
in methodology are needed because, among other 
reasons, utilization research is a costly type of 
investigation and because up to now not enough 
experienced people have been involved in it. 

Mr. Bugbee's words were underscored by 

Dr. Joseph H. McNinch, speaking as Director of 

the Department of Research and Education, 

American Hospital Association; and Director of 

the Hospital Research and Educational Trust. 

(Dr. McNinch is now Chief Medical Director of 

the Veterans Administration medical program.) 

At first glance, he remarked, the amounts 

spent for medical care in this country do not seern 

excessive especially when compared with what 

Americans spend for tobacco, watches, jewelry, 

and automobiles. But "totals and averages are 

often deceptive figures," he pointed out. "The 

average stay of between 7 and 8 days in a hospital, 

at an average cost of $35 a day, has little meaning 



for the individual who is hospitalized for 90 days 
at a daily cost which far exceeds the average." 
Nor is money the only concern, he continued. 
The modern hospital requires skilled personnel 
with experience in many fields, and these person- 
nel are in chronic short supply. Research on hos- 
pital use must continue to seek ways of increasing 
the efficiency of scarce medical manpower. 



Review of Research 

The conference program was devoted 
largely to studies already completed or currently 
in progress. But it also featured a panel discus- 
sion of research methods, another on recommenda- 
tions for future research, and a comprehensive 
review of research on hospital use in the United 
Kingdom, Brief summaries of the various re- 
ports are presented below : 

The importance of a multidisciplined ap- 
proach was exemplified by the discussion of re- 
search methods. On the panel were representa- 
tives of five separate disciplines, each with unique 
study methods that might be brought to bear on 
the central problem. The overall goal of research 
in hospital use, it was agreed, was to promote better 
care of the patient, not only during the hospital 
experience but also in the life situation. Studies 
of medical factors particularly long-range fol- 
lowup studies of hospitalized patients would con- 
tinue to be of primary importance. But studies 
of a socioeconomic nature for example, cost anal- 
ysis and opinion surveys would play a valuable 
supplementary role in determining how efficiently 
medical facilities are used. 

PERFORMANCE OF SURGEONS 
EVALUATED. A new technique for evaluating 
the performance of surgeons in selected operations 
was described by Drs. Osier L. Peterson and Ernest 
K. Barsiunian of Harvard Medical School. Work- 
ing from records in selected Massachusetts hos- 
pitals, they rated physicians involved in the sample 
cases according to criteria that in effect broke down 
each case into component stages preoperative 
diagnosis, agreement of diagnosis and pathology, 
specificity of surgery, complications, etc. Al- 
though their work wns limited to a relatively few 
surgical procedures, it was suggested that the same 
technique might be applied to nonsurgical condi- 
tions and to broader sample groups. 



ATTITUDE AND USE SURVEY. An 
attitude and use survey covering; some 2,000 hos- 
pitalized patients and their doctors, recently con- 
ducted in Massachusetts,. -was reviewed by Dr. Odin 
W. Anderson of the Health Information Founda- 
tion and Paul E. Sheatsley of the National Opinion 
Research Center. As Dr. Anderson pointed out* 
the attitudes of both the patient and the attending 
physician may have bearing on whether or not a 
patient is admitted to a hospital and IIOAV long 
he remains there. By questioning pal ients and doc- 
tors about th& events preceding, during, and fol- 
lowing actual hospital experiences, the researchers 
hope to throw light on the question of how much, 
if any, hospiUlixation is unnecessary, (riven suf- 
ficient funds and personnel, future studies of this 
fype might "be broadened to include maternity 
ciiscs. Also, if a survey were done on a popula- 
tion basis, informal ion might be obtained on per- 
sons who required hosiplal cure but failed to gel it. 

MICHIGAN STUDIES. The Michigan 
studies dealing with hospital use were described by 
Walter T. McNerney, The subject was approached 
from several points of view which were briefly 
highlighted. In two of the studies the value of 
mnltivariant analysis in producing data thai re- 
vealed varying utilization patterns among dif- 
ferent population groups was demonstrated. The 
very accumulation of such data raised questions 
about (he validity of existing hospitalizntion prac- 
tices. Concurrently" the Michigan research team 
launched its landmark study of a sample of pa- 
tients with selected diagnoses, in which actual ad- 
missions experience was compared with standard 
practice developed by expert panels. The selec- 
tion of these panels, some, results of the study, and 
(he relation of this approach to other attempts to 
define criteria were discussed in greater detail by 
Dr. Beverly Payne, Dr. Donald Eiedel, and 
Thomas Fitzpatrick. 

COLUMBIA STUDIES. The significance 
of university research for community planning and 
program implementation was emphasized by Dr. 
Ray E. Trnssell in his review of studies conducted 
by Columbia University's School of Public Health 
and Administrative Medicine, These studies, 
covering a wide range of problem areas and tech- 
niques, have played an important sometimes con- 
troversial rol a in providing data for city and 
State agencies, labor-management groups, health 
insurers, and others concerned with hospital 



utilization. Dr. Jack Elinson, discussing deta' 
o three studies, pointed up ihe need to eonsid 
uonmedioal, social forces in whatever planning 
done. Dr. Josephine ,T. Williams dealt with tl 
methodology of a recent survey of family medic 
care under three types of voluntary heall 
insurance. 

HIP STUDIES. Dr. Paul M. Densen ar 
Sam Shapiro discussed some questions raised t 
their studies of patients in the Health Insurant 
Plan of Greater New York compared with p: 
t ients covered under oilier forms of medical org; 
nization. The studies revealed significantly low< 
admission rales under HIP. After reviowin 
their data, the researchers concluded that fit leai 
part of the differential was attributable to cliffe 
ences in medical organization and methods of pjrj 
ing physicians. But other factors, such us (he ri 
lalivo availability of staff privileges, might also 1 
involved. 



Research m the United Kingdom 

Turning from current research on hospitr 
use in this country, the conference heard a detaile 
description of research on the subject in the Unite 
Kingdom, presented by Dr. J. H. F. Erothersto 
and Dr. J. 0. F. Davies, It was apparent that th 
vastly different factors at work in the two count ric 
made specific comparisons virtually impossible, .1 
-\vas equally apparent that, despite differences i 
tho overall pattern of medical care, the British am 
the American researchers have a number of basi 
problems in common. 



Future Directions of Research 

What of the future directions of researcl 
in hospital use? The panelists discussing this all 
important question, were in general agreement tha 
future progress would depend largely on how mucl 
time, money, and trained personnel could bi 
brought, to bear on the subject. Among tho sug 
gostions for promising approaches : 

More experimental situations should bi 
set- up in which variables could bo isolated am 
studied. 



a For detailed multivariant analyses, 
broad-based population studies will continue to be 
essential. 

* Greater use can be made of records al- 
ready available in such organizations as Blue 
Cross and tlie group-practice medical -care plans 
but more effort is needed to assure the complete- 
ness and comparability of such records. 

* Whatever approaches are tried, the 



panelists agreed, tho role of the doctor and the 
patient must be considered vital in the utilization 
process. 

Finally, it -was emphasized that the hos- 
pital, though of pivotal importance, is only one 
element in the total system of medical care. The 
ultimate goal of research on hospital use, one 
panelist suggested, should be to bolster the effec- 
tiveness of preventive services to a point where 
fewer patients will need to be hospitalized. 



Part II 



Summary of Panel Discussions 



THE NEED FOR A MULTIDISCIPLINED APPROACH 



PANELISTS; 

LESTER BRESLOW, M.D.: Chief, Bureau of 
Chronic Diseases, State Department of Pub- 
lic Health, Berkeley, Calif. 
JACOB J. FELDMAN: Director of Research, 
National Opinion Research Center, Chi- 
cago, 111. 

VICTOR FUCHS: The Ford Foundation, New 
York, N.Y. 

DONALD C. RIEDEL, Ph. D.: Director of Re- 
search and Planning, Blue Cross Associa- 
tion, Chicago, 111. 

JOHN THOMPSON: Director, Program in 
Hospital Administration, Yale University 
School of Medicine, New Haven, Conn, 

Effective hospital care demands thai, many 
persons from related but distinct disciplines pool 
their efforts in a kind of synergistic action for the 
welfare of their patients. The same sort of multi- 
disciplined approach is essential for effective re- 
search in hospital use. 

The panel discussion of research methods 
provided examples of how various disciplines, each 
with unique study methods, can work together in 
examining fundamental problems of hospital 
utilization. 



Dr. Breslow raised some questions about the 
validity of criteria for evaluating quality of care. 
Three categories of criteria, he commented, are 
being used oi i talked about in hospital utilization 
studies. The so-called "normative" criteria for 
example, the usual practice regarding length of 
stay for delivery are of rather limited value. A 
better criterion, he said, is that of expert opinion, 
as when a group of physicians reviews case records 
to determine if everything was properly done, 
But the ultimate criteria, he continued, must come 
from "so-what" studies that point up the relative 
value of alternative medical systems and tech- 
niques in terms of long-range results for patients, 

Although conceding that such studies a-re 
difficult to do, he said that a few starts in this 
direction have already been made, For example, 
he cited the tumor registries in California, to which 
hospitals report not only beginning data about 
cancer cases, 'but also long-term followup data, 
An analysis of some 110>OQO cases over a 20-year 
period showed that patients in voluntary hospitals 
have a. significantly higher survival rate than 
patients in county hospitals. HB also mentioned 
a study by the Kaiser Foundation Health Plan 
to investigate the effectiveness of the multiphasio 
health checkup a battery of laboratory and 
physiologic tests combined with medical followup. 
A sample group of Kaiser subscribers is receiving 
such checkups. This group will be compared with 
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a control group of subscribers over a period of 
years to see. if there are differences in mortality, 
morbidity, and physiologic measurement. 



Economy Analysis Needed 

"So-what" comparisons in the medical area 
do not eliminate the need for economic analysis 
of the situation, Victor Fuchs pointed out. "You 
might find that at the cost of $500 million in extra 
hospital services you are able to achieve a half 
percent better performance on your 'so-whnt' 
measure," he said. "Then the economist would 
ask you to balance that off against other uses that 
might T)e made of hospitals or physician services in 
terms of preventive care or annual checkups or 
something else. You would still bo strung up 
on the fact that resources are scarce and . . . you 
have to make an allocations decision which involves 
au economic dimension." 

Economic concepts relating to costs, de- 
mand, elasticity, production, and other factors are 
pertinent to the health and hospital field, he said, 
and he gave illustrations of how health authorities 
might use these concepts. He also urged that the 
health field make greater use of the economist's 
experience in other industries, especially what he 
has learned about labor and pricing problems. 



Computer Simulation and Bed Requirements 

Computer simulation programs can be a 
valuable tool for study ing and predicting the effect 
>f various utilization patternson bed requirements, 
ccordingto John Thompson. He described a Yale 
tudy of 33 Connecticut hospitals which showed 
these sharp variations when hospitals were ana- 
lyzed according to size of the obstetric &ervice: 



Number of births 
a year 

i,000 and over... 

1,000-1,999 

Under 1,000 



Direct cost Net gain or 
Average of routine loss on ma- 
occupancy service per termty per 
(percent) patient day patient day 

70.6 $6.22 -|-$1.61 

59.9 6.97 -.86 

43.6 10.55 -7.87 



In this instance, lie said, computers showed 
that the determiner of percentage of occupancy 
seemed to be size of service and that services below 



a certain size seemed uneconomic. His group is 
also using computer simulation to investigate the 
possibilities of operating most hospital services 
on the basis of a 5-day week. "We certainly 
would hate to build up a nice big 200-, 800-, or 
400-bed hospital in order to experiment with this 
and then fall flat on our faces," he commented. 



The Sample Survey 

Another research tool the sample survey- 
was discussed by Jacob Feldman. Although sur- 
vey techniques are no panacea for hospital prob- 
lems, he said they can be "quite useful adjuncts" 
to experimental programs, record studies, medical 
audits, and other research procedures. 

For example, record studies "are frequently 
a more economic and reliable means of establishing 
relationships among certain variables." But a 
survey may be useful in showing what processes 
are operating to produce the relationship. He 
cited several specific research problems to which 
surveys might be applied : 

It is known that areas of high bed-to- 
population ratios have higher utilization than 
areas of low becl-to-population ratios. Surveys 
might show how this relationship operates for 
instance, how the admission policies of physicians 
change in an area where a new hospital lias been 
built or an old one shut down. 

Expert opinion and record analysis can 
establish that certain doctors did not follow rec- 
ommended procedures in treating certain patients. 
Surveys of these doctors might help answer such 
questions as: What mental processes accompanied 
the omission of certain desirable procedures? To 
what extent was it "a matter of not knowing any 
better"? What situational factors acted as bar- 
riers to optimum performance ? 

* In seeking ways to control hospital use, 
somebody might set up nn experimental program 
involving review committees, a public relations 
program aimed at staff doctors, and similar tech- 
niques. A survey of physicians and patients in 
such a situation might reveal how they felt about 
such matters as having more procedures done in 
doctors' offices, and what new alternatives might 
be used in certain situations that previously would 
have resulted in hospitalization. 



Sociological Methods 

Donald Riedel concentrated on two problem 
areas where sociopsychological methods might be 
particularly useful. Studies designed to measure 
faulty use invariably involve judgments by ex- 
pert panels or by individuals. The vole of soci- 
ologists and social psychologists here, he com- 
mented, would be to investigate the judgmental 
processes in such studies for example, group 
judgment versus individual judgment and the 
effects various types of leadership have on group 
judgment. 

Social scientists also can add a new dimen- 
sion to cm-rent approaches to measuring quality 
of cure, he indicated. One basic approach con- 
centrates on the technique of administering care 
(e.g., proper surgical technique), while another 
basic approach seeks ways of evaluating the end 
result of the treatment process. But in most 



situations, Dr. Eiedel emphasized, there is also an 
"intervening variable" the patient. 

"It is somewhat dangerous," he said, "to 
simply correlate variations in specifics of adminis- 
tration of care with the degree of recovery. . , . 
For many illnesses, therapeutic advice assumes 
major importance in the treatment process. To 
measure the adequacy of this advice- is one thing, 
but to comment on whether tins advice, per se, 
had an effect on the well-being of the patient, 
without determining how the patient interpreted 
and followed through on the advice, is something 
else. 

"Very few studies have been done to deter- 
mine the disparity between actual and perceived 
therapeutic advice, or on the factors influencing 
compliance with the advice. It may very well be 
that, in terms of wastage of our social resources, 
this area is just as important as studies of overuse 
of facilities," 



A PLAN FOR DISSECTING SURGICAL PERFORMANCE 



PANELISTS: 

OSLER L. PETERSON, M.D.; Department of 
Preventive Medicine, Medical School, Har- 
vard University, Boston, Mass. 
ERNEST K. BARSAMIAN, M.D.: Department 
of Surgery, Medical School, Harvard Uni- 
versity, Boston, Mass. 

The quality of medical care provided pa- 
tients depends largely on the skill and performance 
of the hospital's medical staff. Thus one of the 
main goals of current research in hospital use has 
been to develop valid criteria, for evaluating 
physicians' performances, 

Drs. Peterson and Barsamian described one 
such study an attempt to provide detailed, stand- 
ard criteria for one segment of the spectrum of 
physicians' services. Expert criteria for surgical 
performance were developed which, in effect, 
separated various types of surgical experience into 
component parts diagnosis, treatment, complica- 
tions, etc. These criteria were applied to sample 



cases drawn from the records of selected Mas- 
sachusetts hospitals. The ratings of individual 
surgeons were then analyzed through computers 
according to levels of training tind according to 
hospital affiliation. 

In discussing the need for such criteria, Dr. 
Peterson suggested that traditional measures of 
surgical skill are inadequate for today's demands. 
"There was a time when mortality rates probably 
would have reflected surgical skill," he stated. 
"But antibiotics, blood transfusions, better equip- 
ment, and better anesthesia have made surgery 
remarkably safe." Nor can the competence of 
individual surgeons be adequately measured by 
traditional credentials such as hospital staff ap- 
pointments and membership in the American Col- 
lege of Surgeons: "In the United States most 
doctors expect to have hospital appointments .... 
It is only within the past few years that member- 
ship in the College has become difficult to 
achieve . . . ." Other methods of evaluating 
competence include the accreditation process, rec- 
ord review and tissue committees, and continuing 



educational programs; but "the effects of these 
efforts are difficult to assess." 



Logic Graphs 

In preparation for the Harvard study, Dr. 
Peterson explained, logic graphs were constructed 
outlining the relationships between symptoms and 
pathology for all the diseases commonly found 
in the surgical records of community hospitals. 
These graphs made it possible to separate various 
types of surgery into a series of discrete steps or 
processes which systematized, for example, the re- 
lationships between symptoms and physical ex- 
aminations, between symptoms and diagnosis, and 
between diagnosis and pathology. 

"It is a well-recognized principle that the 
aggregation of data is usually attended with a 
loss of information," Dr. Peterson commented. 
"Separating surgery into a series of steps or proc- 
esses produced a series of related but different 
judgments/' 

Appendectomies, cholecystectomies, and 
pelvic surgery were found suitable for study be- 
cause they are "complex, serious, produce a tissue 
for pathological examination, and are performed 
by surgeons with all types of training.'' 'Criteria 
for the first two procedures included such points 
as whether the removed tissue was "normal" or 
"diseased"; whether transfusion was necessary; 
and whether complications arose. 

Criteria for pelvic surgery were especially 

difficult to develop, Dr. Peterson indicated. The 

pathologist's finding of diseased tissue, for ex- 

ample, did not necessarily mean that surgery was 

called for, He reviewed how criteria were cle- 

r eloped for one condition uterine myoma and 

row physicians handling- cases of this benign dis- 

ase were evaluated according to a 10-step scoring 



Dr. Barsamian, explaining "the reason we 

rent to all this trouble," remarked that "a whole 

hart . . . cannot be graded unless it is dissected 

ito its component parts with each part considered 

aparately for study." Another advantage to 

heir approach, he added, was objectivity; their 

criteria were developed in advance by physicians 

not associated with the hospitals and surgeons 

under study. 



Validity of Standards 

Do these standards measure real differences 
in performance, or might they reflect merely one 
style of teaching-? Replying to this question, Dr. 
Barsamian said the standards in this study "are 
far below those which I use in grading my second- 
year students in physical diagnosis. We think 
this is only fair because parts of the examination 
or findings might be omitted from the patient's 
record." 

He conceded that these standards "are only 
as good as the people who make them. However, 
the advantage is that they apply to everyone and 
are reasonable, because we did not attempt to have 
them include anything that could be regarded as 
controversial. There are lots of things in medi- 
cine upon which two people will not agree. There 
are certain things, however, upon which all people 
will agree and a few other things upon which 
more than 95 percent of the people agree. This is 
what we have attempted to adhere to. Since our 
standards exclude controversial points, if they are 
cut clown any further, some of their essence will 
be lost." 

Although this study was limited fo a rela- 
tively few surgical procedures, Dr. Barsamian 
suggested that the same approach could be used in 
developing standards for medical and obstetrical 
performance. Such standards might- also bo used 
in evaluating length-of-stay data. 



Purpose of Scoring 

The purpose of scoring the surgeons' per- 
formances was not to pass judgment on indi- 
viduals but to provide information for computer 
analysis. As Dr. Barsamian put it : "We want to 
know if surgery is done equally well by the family 
doctor and by the fellow who has spent 4 years in 
surgery. We think not, but there is no conclusive 
evidence that this is so. . . . 

"There are many other questions, such as 
the influence of the medical school on the end 
product, the influence of the hospital training 
program, the influence of the student's family 
background, and his degree of intelligence, which 
can all be answered once objective judgment of 
the medical or surgical care record is achieved. 



8 



"A form has been constructed for classi- 
fication of doctors by specific criteria. By means 
of a simple checklist doctors can be classified by 
such criteria as length of training, medical schools 
attended, grades obtained, and type of hospital 



where training was obtained. All kinds of ques- 
tions can be immediately answered by merely 
changing the classification at the top of the page, 
since the framework of evaluation of care remains 
the same." 



A SURVEY OF HOSPITALIZED PATIENTS AND THEIR DOCTORS 



PANELISTS: 

ODIN W. ANDERSON, PH. D.: Research Di- 
rector, Health Information Foundation, 
The University o Chicago, Chicago, 111. 
PAUL B, SHEATSLEY: Eastern Representative, 
National Opinion Research Center, The 
University of Chicago, New York, N.Y, 

The attitudes of patients and attending phy- 
sicians obviously have an important bearing on 
hospital utilization patterns. To investigate the 
attitudes at work in n fairly representative U.S. 
setting, the National Opinion Research Center and 
the Health Information Foundation recently sur- 
veyed about 2,000 hospital discharges and their 
doctors. 

From a representative sample of 50 general 
hospitals in Massachusetts, a sample of patients 
wore interviewed in. 1960-61, usually within a few 
weeks following discharge. Maternity cases were 
excluded, Sample cases were drawn from the hos- 
pital records over a 12-month period to avoid sea- 
sonal variations. 

The patients were questioned extensively 
about their hospital experience and tlio events 
leading up to and following if,. Each patient was 
asked to name the physician who recommended 
hospitalization and also the doctor who attended 
him in the hospital. (In about two out of three 
cases these were the same physician.) Interviews 
with these doctors made up the other part of the 
survey. 

Massachusetts was selected as an area which 
has a well-developed hospital and medical estab- 
lishment, rural and urban conditions, a range of 
occupations and similar factors present in most 
areas of the United States today. There are an 
estimated 600,000 non-obstetrical discharges an- 



nually from general hospitals within the State, 
The Slate has ft relatively high hospital admis- 
sions rate 116 per 1,000 population, excluding 
maternity, in 1061 and one of the highest pro- 
portions of population covered by hospital insur- 
ance about 80 percent. 



Patient Interview 

Discussing some results of the interviews 
with patients, Dr. Anderson reported that admis- 
sions and discharges corresponded "somewhat" to 
a 5-day week, Monday, for instance, had more ad- 
missions than any other day, while Friday and Sat- 
urday had the fewest. The obverse hold true for 
discharges. 

Same-day emergency admissions (including 
accidents) accounted for 32 percent of all admis- 
sions, while, at the other extreme, 83 percent of 
admissions were for illnesses that had been present 
for more than a year. Thus, about a (hird of all 
admissions required round-the-clock, standby fa- 
cilities and personnel, ho pointed out. "If we wish 
to add maternity care to the total of admissions, 
about 45 percent of all admissions are then on a 
standby basis." 

About 4Y percent of the patients said they 
had seen a doctor at the first sign of the illness 
for which they \voro hospitalized. About 49 per- 
cent had "waked awhile." The "great majority 
of those who delayed seeing a physician almost 
80 percent gave as their reason that they did not 
believe their illness was serious enough, and only 
3 percent of the patients mentioned financial 
reasons." 

In almost, four out of every five admissions, 
Dr. Anderson continued, the patient said that the 
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doctor recommending hospital! zation had indi- 
cated that it was "absolutely necessary." About 
03 percent of tlie patients reported that they had 
complied with the recommendation gladly or 
willingly. 

Among the patients sent to the hospital 
for an operation, 04 percent had felt that the pro- 
cedure was "absolutely necessary." It. was inter- 
esting, said Dr. Anderson, that "only 3 percent 
of those who thought the operation was necessary 
volunteered the opinion that their lives were being 
saved, and that 80 percent felt that the operation 
would prevent more serious trouble in the future 
or relieve or correct the condition .... It is 
still within living memory when operations were 
regarded largely as a life-saving procedure." 

What about unnecessary use? The survey 
showed a "gray area" of between 10 and 20 per- 
cent of all admissions where, Dr. Anderson ob- 
served, "decisions could have gone either way' 1 
regarding in-hospital or out -of -hospital treatment. 
Studies of that 10-to-20 percent might be helpful. 
In general, though, the results suggested that 
"neither doctors nor their patients are really push- 
ing hard at the door of the hospital." He cau- 
tioned that this survey, being limited to patients 
who actually had been hospitalized, made no at- 
empt to measure the extent to which hospital care 
vas recommended but never received. 



Physician Interviews 

Paul ShPfitsley described the steps taken 
to obtain the cooperation of the doctors selected 
for interview. The 2,046 patients who were in- 
terviewed named 2,081 doctors as their recom- 
mending or attending physicians. The National 



Opinion Research Council obtained complete inter- 
views from 2,137 of these doctors, or 80 percent. 
"I think this is a fairly remarkable record," 
Mr. Sheatsley said. One key factor in this show- 
ing, he added, was the close cooperation received 
from medical and hospital authorities in the State. 
For example, two notices about the survey ap- 
peared in the New England Journal of Medicine. 
The State medical society sent letters to each dis- 
trict society, explaining the study and asking the 
society to pass along the information to its 
members. 

Just before the interviewing period began, 
the State society sent a mass mailing to all its 
member physicians, informing each that one or 
more of his patients might have been selected for 
study. (When N.O.R.C. wrote the doctors whose 
patients had fallen into the sample, a copy of this 
medical society letter was enclosed.) In addition, 
said Mr. Sheatsley, "we talked with the adminis- 
trator in each sample hospital, and ho often dis- 
cussed the study with his medical staff and en- 
couraged them to offer us their cooperation." 

Another important element in the success- 
ful interview record, he commented, was "the care 
and skill in conducting the interviews." For one 
thing, "we were careful to get signed permission 
forms from the patients interviewed .... We 
concealed nothing from the doctors .... Our 
interviewers were alert, intelligent, resourceful 
women who had been extensively (rained for this 
study. They were highly motivated and, above 
all, persistent, We gave the doctor all the time 
he needed. If Hie doctor was unable to give us 
an immediate appointment, we called every few 
weeks or wrote him a second letter .... I think 
all of this impressed the physicians with the 
importance of the survey and contributed to the 
results." 



MICHIGAN STUDIES IN HOSPITAL USE 



PANELISTS; 

WALTER J. MCNERNEY: President, Blue 

Cross Association, Chicago, 111. 



BEVERLY C. PAYNE, M.D.: School of Busi- 
ness Administration, University of Michi- 
gan, Ann Arbor, Mich. 
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DONALD C. RIEDEL, Ph.D.: Director of Re- 
search and Planning, Blue Cross Associa- 
tion, Chicago, 111. 

THOMAS B. FITZPATRIGK: Director of Re- 
search, School of Business Administration, 
University of Michigan, Ann Arbor, Mich. 
(Now with Hospital Service Association of 
Western Pennsylvania, Pittsburgh) Pa.) 

As Chairman George Bugbee pointed out, 
utilization rates are known to vary widely from 
place to place, but very little is known about 
''proper" hospital use. 

A University of Michigan study, covering 
about 11,000 discharges from a probability sample 
of 70 Michigan hospitals in 1958, ranks as one of 
the most detailed efforts yet made to develop flex- 
ible, objective criteria for evaluating the validity 
of admissions, in-hospital services, and length of 
hospital stay. 

Walter McNerney, reviewing earlier studies 
at the University's School of Business Adminis- 
tration, singled out a number of findings of basic 
importance to utilization research. For example : 

One study showed that persons with more 
than 70 percent of their hospital bill covered by 
insurance had almost twice the admission rate of 
those without insurance coverage. There was also 
some evidence that the seriousness of symptoms 
had little bearing on plans to get hospital caro. 

Another study reported a "strong asso- 
ciation" between hospital utilization and avail- 
ability of facilities. For instance, ''the largest 
single cause of variation in patient days, some 71 
percent, was attributable to the number of beds 
available." 

In a study' of large groups that left com- 
munity-rated Blue Cross plans lor experience- 
rated commercial insurance plans and vice versa, 
the groups leaving Blue Cross had a significantly 
lower average loss ratio than those leaving the 
commercial plans for Blue Cross. 

Such studies, which consisted largely of 
statistical analyses of routine, available data, 
demonstrated the value of multivariant analysis 
5n dealing with large population groups. How- 
ever, as Mr. McNerney put it ; "We wrestled during 
the early stages with the problem of how to meas- 
ure the validity of hospital use." 



Measuring Validity of Use 



The Michigan group considered several 
possible approaches to this problem. A longitudi- 
nal approach was ruled out because it "promised to 
offer many technical as well as cost problems." 
Another possible approach was to have knowledge- 
able physicians look at the records and make pro- 
fessional judgments according to such things as 
history, physical examination, relevancy of the 
procedures, and length of stay. But this approach 
was discarded as too subjective: "It involved too 
many opportunities for physicians to rationalize 
differences. In Hie absence of any specific criteria 
or reference points, it would have been difficult to 
evaluate the results in retrospect or to have dupli- 
cated the method over time even within one 
institution." 

The approach finally settled on was de- 
scribed by Mr. McNerney as "flexible criteria . . . 
developed by experts and applied to a probability 
sample of records in a probability sample of hos- 
pitals." There were some drawbacks to (his 
method: It was time-consuming, and it raised the 
clanger (hat the criteria would become "sanctified 
or used even when outdated." Bu through this 
method, he pointed out, "appropriateness of ad- 
mission, relevance of procedures, and understay 
as well as overstay could be measured." And it 
had these other advantages: (1) It could reflect 
the "best thinking available at a given point in 
time, assuming the experts were well selected." 
(2) It could be objective, since criteria could be 
developed "prior to the evaluation and by different 
people." (8) The method "could be duplicated 
consistently within a hospital or among hospitals 
over time." (4) Tfc could give "some substance to 
the idea of norms and still leave room enough for 
interpretation'' through interviews with attending 
physicians. 



Developing Criteria 

As the survey progressed, criteria were de- 
veloped for 18 diagnostic categories which in the 
aggregate covered 47 percent of all discharges from 
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Michigan hospitals. According to Dr. Payne, who 
described at length how the criteria were drawn 
up, the 18 diagnoses were divided among 7 expert 
panels consisting of from 3 to 6 physicians each. 

In general, the panelists were physicians 
"who were considered outstanding because of their 
training, their participation in medical educational 
efforts, and who were recognized by the physicians 
in Michigan as a peer group." Each panel, in one 
evening of intensive discussion, drew up criteria 
relation to (1) admissions; (2) procedures neces- 
sary and consistent with the diagnosis; (3) com- 
plications that might affect length of hospital 
stay; {4} expected length of stay; and (5) in- 
dications for discharge. The criteria were then 
codified or listed in some coherent fashion. 

The criteria were usually very rigid regard- 
ing admissions and flexible otherwise, said Dr. 
Payne. Length of stay, for instance, was stated 
as a range of days rather than ns a specific number 
of days. The Michigan criteria were less detailed 
than those in the Harvard study discussed earlier. 
The reason, Dr. Payne explained, was that the 
latter is concerned primarily with qualify of care 
whereas "we are concerned with the length of stay 
and appropriateness of admission." 



Evaluating Data 

Once criteria had been drawn up, teams of 
medical students with a physician in charge 
visited the hospitals in the sample and abstracted 
about 5,750 case records. Data were evaluated by 
three physicians and classified either as "uncler- 
stay," "appropriate stay,'' or "overstay/' All 
cases considered overstay or understay, and a 
sample of the appropriate stays, were singled out 
for interviews with the doctors involved. Inter- 
views were carried out. with a total of 842 physi- 
cians who were responsible for about 1,700 cases. 
Final evaluation of the cases was made following 
the interviews. 

Citing a few findings from the two-volume 
study, Dr. Payne recalled that 83 percent of the 
cases were "appropriate" slays, while 6.8 percent 
were understays and 9.6 percent were overstays. 
Two percent of the admissions were considered 
inappropriate. 

As for the characteristics of the hospitals in 
the study and their medical staffs, he noted that the 
larger hospitals "those having a large burden of 
welfare cases" had not only a longer length of 
stay but also more inappropi-iate use of the hos- 
pital. This trend increased as hospitals assumed 
a large responsibility for teaching. 



THE USE OF RESEARCH DATA 
IN HOSPITAL AND COMMUNITY PLANNING 



PANELISTS: 

RAY E. TRUSSELL, M.D.: Commissioner of 

Hospitals, City of New York, New York, 

N.Y. 

JACK ELINSON, Ph. D.: School of Public 

Health, Columbia University, New York, 

N.Y. 

JOSEPHINE J. WILLIAMS, Ph. D.: School of 

Public Health, Columbia University, New 

York, N.Y. 

While researchers seek to ping gaps in our 
mowledge of hospital use, persons concerned with 



hospital pi finning and program implementation 
must make important decisions on the basis of data 
currently available. 

This point was repeatedly emphasized by 
Dr. Kay Trussell in his review of studies conducted 
by Columbia University's School of Public Health 
and Administrative Medicine. These studies 
which used such varied techniques as household 
surveys, expert evaluation of case records, and 
statistical analysis of insurance records have pro- 
vided data for city and State agencies, labor- 
management groups, hospital planning councils, 
health insurers, and others concerned with hos- 
pital utilization. (As New York City's Commis- 
sioner of Hospitals, on leave from Columbia, Dr. 
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Tiiissell himself now implements policies based 
partly on research clone under his direction.) 

"At Columbia we are a group who enjoy 
doing something about the problems we study," 
he noted. This enthusiasm, he added wryly, "is 
not uniformly shared by certain hospitals or phy- 
sicians in New York." Nevertheless, the use of 
research studies in hospital planning is "a healthy 
trend, provided research does not become perverted 
into a basis for indecision." 



Pertinent Studies Reviewed 

Among the studies described by Dr. Trus- 
sell, the following results were especially pertinent 
to research in hospital use : 

* An analysis of Blue Cross records in the 
New York City area led to the conclusion that hos- 
pital cost per unit of service would continue to rise, 
partly because of unnecessary admissions and pro- 
longed stay. Unnecessary hospital construction 
was singled out as a key factor in overutilization. 
As an outgrowth of the study's recommendation 
that hospital construction he dealt with at the 
local regional rather than at the community plan- 
ning level, the State legislature created a Hospital 
Review and Planning Council and the Governor 
has encouraged formation of regional councils. 
"Currently in New York State," said Dr. Trussell, 
"we are involved in a bit of a strained situation 
about giving the Regional Councils the authority 
that we really think they should have to really do 
planning, to investigate unnecessary building and, 
at the same time, to encourage necessary building." 

A household survey and medical audit, 
covering hospitalized members (and families) of 
Teamsters Joint Council No, 16 of New York City, 
concluded that only about 80 percent of the hos- 
pital admissions received by this group wero nec- 
essary, and that there was no indication for a 
substantial amount of the surgery performed. 
One of the germane results of this study was that 
Columbia University and Montefiore Hospital 
agreed to cooperate in maintaining a diagnostic 
center for Teamsters' members in a new wing built 
by the union, The Teamsters are also under- 
writing further studies of medical auditing 
techniques. 



A household interview survey of 300 

families associated with New York City's hotel 
industry showed, among other findings, that about 
one-quarter of the hospital admissions were in 
non-accredited, proprietary hospitals and thai 
about a quarter of thu physicans (hat patients 
thought- of as specialists actually wore not. Ac- 
cording to Dr. Trussell, the labor-management 
officials who ordered this study "were so dis- 
gruntled with the profile of care presented . . . 
that they made a policy decision to go into thoir 
own full-time group practice." 

A Columbia team headed by Frank Van 
Dyke is doing a series of studies of the medical 
caro provided by New York City. One of these-., 
recently completed, deals with patients hospital- 
ized for 30 days or longer in a sample of voluntary 
and a sample of municipal hospitals. It WITH 
ordered, Dr. Trusses!! remarked, "to help me ex- 
plain some of the problems (o [he Budget Director 
and the Mayor." 

Among the long-stay patients in the foui 
municipal hospitals in the sample, he added, "fiC 
percent . , . wero judged by an mil side team ol 
internists, social workers, and nurses not to bo in 
need of general hospital care, Some could gL 
home, and others could go to foster homes, to home 
care, or to nursing homes." This study identinoc 
"a whole series of problems which con front mi 
and the city administration in dealing with th 
kind of patient." ITor example: "We are closing 
up substandard nursing homos faster than build 
ing new nursing home beds. Wo do not 1m vi 
enough social workers. Also, not, nil doctors im 
interested in following through on discharge plans 
for thoir patients. The aclininisl ration become 
so used to an individual that sometimes you wil 
find a patient who has been ihero for S years ant 
has become a sort of pet of the staff. Also, evoi 
in Iho voluntary hospitals, which have a grav 
deal moro flexibility regarding which patient: 
they take or do not take, 26 percent of the long 
stay patients did not need to bo in nn acute genera 
hospital." 



Studies Stress Social Forces 

Dr. Elinson discussed three other Columbi 
studies: a survey of about 600 New Jersey phyai 
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citins to determine what kinds of doctors they 
themselves n?e when they or their families need 
medical fare; H survey of families in Puerto Rico, 
to explore patterns of utilization of medical care; 
nnd n hospital-utilization profile of the population 
of "HVhinirtim Heights, the neighborhood in 
upper Manhattan that surrounds Columbia Pres- 
byterian Medical Center. 

None of these studies', said Dr. Elinson, 
could he considered a "?o-what study" in the sense 
of evaluating the effectiveness of various ap- 
proaches to hospital and medical care. Xeverthe- 
K'^s, from this varied set of f-tudies he drew a 
broafl overall conclusion: that "there are very 
powerful nonmedk'al social forces, i.e., indexed by 
menibfr.ship in .social groups which may have to 
Ixi taken account of s-omehow in whatever planning 
is tlone." For example, the kind of hospital a 
porFO-n is likely to go to I in Manhattan) is u 
function of his 4vin rolnr and religion ; the doctor 
he vKith in Puerto Ili<>o depends on whether he is 
poor, rich, nr middle clas.^: and if a person is a 



member of a physician's family (in New Jersey), 
clearly enjoys a very special pattern ol medical 



care. 



Hospital Use Under Three Types of Insurance 

Dr. Williams gave a detailed account of 
the methodological approach followed in a Co- 
lumbia study published in 1962, "Family Medical 
Care under Three Types of Health Insurance." 
The purpose was to compare utilization and cost 
of hospital and medical care under three different 
types of health insurance plans. Matched samples 
were obtained from (i) New Jersey Blue Cross- 
Blue Shield; (2) General Electric's major medical 
plan; (8) the Kaiser Foundation Health Plan. 
The main finding on hospital utilization, accord- 
ing to Dr. Williams, was that, "considering the 
sampling variability, wo found no evidence of 
any difference in hospital utilization between the 
three plans/' 



HOSPITAL USE UNDER VARYING FORMS 
OF MEDICAL CARE ORGANIZATION 



PANELISTS: 

PAUL M. DENSEN, Sc. D.: Deputy Commis- 
sioner- of Health, City of New York, New 
York, N.Y. 

SAM SHAPIRO; Director of Research and Sta- 
tistics. Health Information Plan of Greater 
New York, New York, N.Y. 

One frequently disMi^sed ''physician vari- 

ih'" 1 K (lie form <if medical oriranii'ation under 

Inch dot-tors pnnlice. Among (he landmark 

(mtii'.s in this aim have been eever.il comparisons 

molving pafienLs who receive tlieir medical care 

miter the Health InMiranw? Plan of Orealer New 

York. ;i group practice prep;v\ment plan. 

The Itjisir approach of these studies, Dr. 
Den.sen recalli'd, \\aft to "approximate the labora- 
tory situation" by finding actual situations in 
which the hospital experience of an HIP popula- 
tion could he compared with that of a "reasonably 
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comparable non-TIIP group."' The sludies made 
no a'-umptions alioul what JiospihiliKatmn has fo 
do with i|ii!tlity of care, he added. ""Wo simply 
i\eu' hiteii'sit'd m seeing ulmf happens iohospital- 
ization under difl'erenf ways of providing medical 
cure." 

Hi a 1055 .study, Blue Cross records wore 
used ns a basis for comparing hospital utilization 
rates of HIP subscribers with those of comparable 
occupational groups insured by Blue Shield. The 
admission rale (non-obstetrical) was 59.6 per 1,000 
popululion for the I1TP group, 77.3 for Blue 
Shield. For adults 25 years of age and over, the 
comparable rales were 08.7 and 83.4. 

The two groups reflected differences in 
meclicul organisation and method of compensating 
physicians. But (hey also reflected differences in 
insurance benefits for medical care : HIP provided 
"comprehensive medical care across the board," 
whereas the Blue Shield benefits were largely 
limited to in-hospital services, 



Dual-Choice Arrangements 

In an effort fo control the benefit variable, 
the HIP research group conducted a 1956-57 
study among members of the Dress Joint Board 
of the International Ladies Garment Workers 
Union. These members were ottered a, dual-choice 
arrangement they could choose medical benefits 
under either HIP or Group Health Insurance, 
The two programs were similar in Blue Cross 
benefits and medical benefits. They differed, how- 
ever, in medical organization and method of pay- 
ing physicians: GHI "has no medical care organi- 
zation for which i(, is directly responsible. It 
works with the doctors in the community as does 
a regular insurance program." 

Again in this study, HIP emerged with 
lower admission rates 63.8 for adults aged 25 
and over compared with 72.8 for the GHI group. 
But what selective factors were operating which 
led one part of the membership to choose HIP 
and the other part to choose GHI? Dr. D&nsen 
cited evidence that "these selective factors, what- 
ever they were, were not related to the question of 
health status." It was his guess, he added, that 
choice of plan in this situation was "not so much 
an individual decision as a decision based upon 
the particular attitude of the union leadership." 

In another study of a dual-choice situation, 
the lower admission rates noted in the first two 
studies were not borne out. This comparison in- 
volved District No. 65 of the Retail, Wholesale, 
and Department Store Workers Union. Some of 
the members were insured for medical benefits 
under HIP, while the others were self-insured by 
the union. 

"In essence," Dr. Densen commented, "we 
found no difference in the hospital utilization rate 
between the HIP group and the group that utilized 
the union's own program for providing medical 
benefits and hospital benefits." But he noted that 
this union "exercised a considerable control over 
the utilization of the hospitals by its membership, 
For example, it looked at the bills, and it con- 
ducted an educational program. This particular 
union has quite a paternalistic attitude it tries 
to keep its membership pretty well identified with 
the union." 

He stressed that, "although there was no 
difference in hospital utilization in these two 



groups, the hospital admission rates themselves are 
very low." For all ages, the HIP rate was 48.6 
and the union-insured, 50.5 per 1,000 ; for adults 
25 and over, the rales were 55,5 and 54.4, respec- 
tively. 



Questions Raised 

Dr. Densen and Sam Shapiro also discussed 
some "residual questions" raised by these studies. 
One question dealt with the possibility that lower 
HIP admission rates might he due in part to 
difficulty that HIP doctors may have in securing 
beds. To examine this possibility, the research 
group rcstndied data from the 1955 Blue Shield- 
H1P comparison with these results : 



Classification. 

Blue Cross-Blue Shield 

Blue Cross-HIP 

Classification by hospital appointment 
(HIP] 

Medical groups where at least % of 
family physicians have appoint- 
ment on staff of one or more 
voluntary or proprietary hospi- 
tals 

Medical groups where at least H of 
family physicians have appoint- 
ment as associate or attending 
physician on staff of one or more 
voluntary or proprietary hospi- 
tals ,_ 

Medical groups where less than % of 
family physicians have appoint- 
ment on staff of one or more 
voluntary or proprietary hospi- 
tals 

Classification by judgment about access to 
hospital beds (IiIP} 

Medical groups where there is ample 
evidence that no special problem 

exists 

Rest of medical groups (contains 
some medical groups where the 
problem, if it exists, is considered 
not to be important) 



1955 Ad- 
mission 
Kates 
(Non-Ob- 
stetrical) 

77.3 
59.6 



62.2 



62.3 



53.1 



07.4 
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"If we take these data as they stand," said 
Dr. Densen, "it is hard for me to see how access 
to hospital beds in and of itself can. account for 
the differences we have in the two studies. It 
may be, a contributing factor, but it does not ac- 
tually account for all of the differences." 

Mr. Shapiro emphasized that, in compari- 
son studies of this type, researchers should "be 
prepared for small but important differences. 
The margins in the first two sets of comparisons 
presented were 15 to 20 percent, and these could 
easily have been missed, if large samples had not 
been used." 

Another important point, he added, is the 
"desirability of making comparisons between pop- 



ulations subject to similar local area conditions. 
The significance of this factor is apparent in view 
of the known variability of hospital admission 
rates and duration of stay by geographic area." 
He also touched on a "residual question": 
How is it that, despite the generally lower HIP 
admission rates, the actual duration of stay does 
not differ substantially between HIP and other 
groups? Attemps to classify the early study ma- 
terial by diagnostic category had not answered 
this question, he indicated: "Briefly, no consistent 
patterns were found." He expressed the hope that 
other hospital studies would throw more light on 
the problem. 



RESEARCH OKT HOSPITAL USE IN THE UNITED KINGDOM 



PANELISTS: 

J. H. F. BROTHERSTON, M.D., D.P.H.: Dean 
of Medical Faculty, Professor of Pitblic 
Health and Social Medicine, University of 
Edinburgh, Scotland. 

J. O. F. DAVIES, M.D., D.P.H.: Senior Ad~ 
ministratfae Medical Officer, Oxford Re- 
gional Hospital Board, Oxford, England. 

British and American hospitals, Dr. Broth- 

rston pointed out, are used in "somewhat different 

fashions." In the United Stales, for example, the 

hospital "is used more frequently, nl though for 

shorter durations of stay and with, apparently, 

a higher content of surgical activity.' 1 On the 

ither hand, hospitalized British patients "are jil- 

nost certainly much sicker" than 1 T .S. admissions. 

V.nd British data show much greater admission of 

isolates'' (single and widowed) as opposed to 

hose married "suggesting that our hospitals are 

ised to a greater extent fo compensate for certain 

oeial deficiencies as well as to provide clinical 

are." 

Such differences themselves a reflection of 
nore fundamental differences between the medical 
are systems us well as the overall cultural struc- 
urcjs of the two countries make direct compari- 



sons in specific areas of hospital utilization vir- 
tually impossible. Vet it was apparent, from Dr. 
Bi-other&ton's and Dr. Dimes' review of recent 
British research, that studies in both countries 
have focused 011 many similar problems. 



Bed/Popiflatiou Ratios 

In the paht, Dr. Brothers ton said, British 
studies of bed/population ratios Bought to approxi- 
mate some "ideal" figure; now, however, "there 
seems to be tacit agreement that 'need' ... is too 
variable and elusive a concept to be measured. In- 
Htead, measurement of manifested demand is sub- 
stituted." Various attempts to estimate bed needs, 
such as the "critical number" technique developed 
by Bailey, have suggested "an apparent equilib- 
rium between supply and demand." Many fac- 
tors (e.g., an enormous range in number of refer- 
rals by general practitioners) may serve to main- 
tain this equilibrium. Studies dealing with the 
"phenomenon of supply apparently determining 
demand" seem to be "the best we have available," 
he said. But if this phenomenon is to be used in 
planning, he added, "it is essential to appreciate its 
limitations fully. Otherwise there is a real danger 
that we may be taken in by our own figures, and 
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begin to confuse 'manifested demand' with real 
need." 

A number of assessments have been made 
by record study and consultation with clinicians 
in an attempt to evaluate whether patients actually 
occupying beds in general hospitals belonged there. 
Estimates of "misuse" vary between 4 and 25 per- 
cent of the patients studied, Dr. Brotherston said. 
Although such data are useful, lie questioned how 
far problems of medical care can be divorced from 
the social context in which the problems exist. 



Efficiency of Use 

Increasing effort is going into studies de- 
signed to raise the efficiency with which existing 
hospital resources are used, he continued. Dal a 
arising from the National Health Service, for ex- 
ample, may be used eventually as a kind of external 
audit. A number of "so-what studies" have been 
conducted : One such study, which compared the 
outcomes of certain clinical conditions, showed 
a markedly higher mortality rate in noutenching 
hospitals as opposed to teaching, and drew at- 
tention to the relatively more favorable staffing 
and other factors in the teaching institutions. But 
almost nothing has been done about studying medi- 
cal behavior in the hospital, he said. 

Some studies of outpatient services are now 
going on, Dr. Brotherston indicated. These are 
looking into such questions as who visiis outpatient 
services, why they come, what happens to patients 
as they go through the system, what is the outcome, 
etc. In effect, this area of research is examining the 
"linkage points" between the hospitals and another 
major part of the medical-care system the gen- 
eral practioners who refer patients to the 
hospitals. 



Role of the General Practitioner 

Both Dr. Brotherston and Dr. Davics 
stressed the need to supplement research on hos- 
pital use with studies of out-of -hospital facilities 
notably the practices of general practitioners but 
including social services, homes for the aged, re- 
habilitation facilities, and other services. 



The general practitioner is the first line 
contact in medical care for the great majority ' 
the British population, Dr. Brotherston pointi 
out; and he is also responsible for continuity i 
care. But "of technical advance in general prn 
tice there is little sign and for Hie simple reasc 
that wo have not yet found a menus ... to brh 
about an industrial revolution for the goner 
practitioner." In the early days of the Nation 
Health Service there were plans f o establish healf 
centers to provide general practitioners with mtij< 
resources in equipment and personnel; but tl 
health center idea "has not yet got o/T the ground 

Followup studies of hospital patients mn 
"shatter complacency," he said. A 19fi4 stud 
suggest ed thnfc the advisory aftercare service pn 
vided in Glasgow "seemed to have made little ( 
no difference in results. Ferguson reported (lit 
the Glasgow study makes it clear that, valuable t 
they may be for snort-term aid, the social serviei 
at present available will not greatly affect the n 
suits of hospital care. Ho slates, however, tin 
betler social and rehabilitation services might lea 
to improvement." 



A "N^z/J Look" at Hospitals 

Dr. Davics, who is "on loan" to the Ministr 
of Health from the Oxford Regional Hospili 
Board, described some current activities in tli 
Ministry's Department on Hospitals. 

As part of the Ministry's "new look," li 
remarked, the Department on Hospitals has bftgu 
to produce guide material on hospital planning- 
a sharp departure from the previous practice c 
examining plans critically and commenting o 
them. Through the guides and informal discus 
sions fcho Department still exerts "a fair amour 
of influence" on projects proposed by region! 
hospital boards, said Dr. Davies. Once a projec 
has been agreed upon, the regional boards aro e? 
pooted to keep within cost, limits. But (.hoy in 
"very much on their own insofar as actual cor 
stru&tion is concerned." 

The latest approach to planning, he stresscc 
"involves the provision of quite largo hospitals, 
capable of providing good general, geriatric, an 
psychiatric service. The minimum number o 
beds for such a hospital would bo no lower fcha 



300, while the maximum has not been specified. 
For a population of 150,000 persons, a hospital of 
from 600 to 800 beds would probably be required. 
"The intention is to develop our outpatient 
departments and make them really effective instru- 
ments," said Dr. Davies. "We propose to give 
them what we call day beds to which the patient 
can be admitted for the day or night for investiga- 
tion desired that day. If the surgeon desires to 
do outpatient surgery, he can do it and have a bed 
available for the patient to rest before going home 
the same day." 



The Department also has set up a small 
group to foster management studies a kind of 
"intelligence section" to bring together knowledge 
about how hospitals are being run, distill it, and 
dispense the findings to the hospitals. Recent 
field studies by teams from the Department have 
revealed a variety of shortcomings in the actual 
operation of the hospitals visited. As Dr. Davies 
commented: "The more studies there are, the more 
it is seen that what actually goes on differs in some 
ways from what is intended. The more studies 
that lead intention to action, the better." 



GUIDELINES FOR FUTURE RESEARCH 



PANELISTS; 

PAUL M. DENSEN, Sc. D.: Deputy Commis- 
sioner of Health, City of New York, New 
York, N.Y. 

WALTER J. McNERNE Y : President, Blue 
Cross Association, Chicago, 111. 
GEORGE ST. J. PERROTT: Acting Director, 
Division of Research and Statistics, Group 
Health Association of America, Washing- 
ton, D.C. 

WILLARD A. WRIGHT, M.D.: Council on 
Medical Service, American Medical Asso- 
ciation, Williston, N. Dak. 
KERR L. WHITE, MX).; Professor and Chair- 
man, Department of Epidemiology and 
Community Medicine, University of Ver- 
mont, Burlington, Vt. 
J. H". F. BROTHERS-TON, M.D.: D.P.H.: Dean 
of Medical 'Faculty, Professor of Public 
Health and Social Medicine, University of 
Edinburgh, Edinburgh, Scotland. 

There was general agreement among the 
panelists Mint more sophisticated studies of hospi- 
tal use are needed. The current body of research 
information has provided a solid foundation, but 
future progress will require substantial increases 



in terms of the time, money, and trained person- 
nel brought to bear on the subject. Each panelist 
also mentioned one or more specific approaches 
that warrant further study. 

Experimental situations can be set up to 
investigate factors operating in the community at 
large which affect hospital utilization, Dr. Densen 
stilted. He cited a current study involving a New 
York City welfare population. One thousand 
welfare patients arc receiving comprehensive 
medical care through New York Hospital serv- 
ices of staff physicians sire provided in the hos- 
pifal, in the homo, in the outpatient department 
and, if necessary, in the nursing home. A control 
group is receiving medical care in the way usually 
available to welfare department clients a panel 
physician arrangement which in practice results 
in a heavy concentration of home visits. The two 
groups are being compared in terms of utilization 
of medical facilities, visits to outpatient services, 
hospitalization rates, and the costs involved. 



"Bolder Steps" Needed 

Walter McNerney urged, in effect, that 
future researchers see the forest as well as the 
trees. "If I could express a general prejudice," 
lie said, ". . . it is that more research needs to be 
done on a population basis and on an episodic 
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basis, utilizing many of the new sampling and 
analytical tools that have been developed in recent 
years. We are attacking too many problems on. 
a highly segmented bnsis and finding ourselves 
unable to talk of meaningful results or implica- 
tions. We now have both the insights and tech- 
niques to take bolder steps." 

A great deal of work can be wasted, ho 
warned, unless "qualitative references or measures 
of effectiveness are developed." Moreover, "when 
we talk about these types of research we arc 
talking about major sums oC money. We must, 
then, get used to the idea that $500,000 is not an 
improper amount of money to spend, especially in 
terms of the importance of the- many policy de- 
cisions that are involved." 



Potential Value of Group Prepayment "Plans 

Potentially, said George Perrott, the rec- 
ords of group practice prepayment plans offer an 
opportunity for doing population studies. But in 
actual practice the records of many of these plans 
are not adequate for intensive study . 

He described a "barnstorming tour" of some 
18 plans which he made recently as part of a study 
designed to collect descriptive data on their op- 
eration. "The plans visited varied in size from 
2,400 to 664,000, embracing a total of 1,575,000 
enrollees. Some own their own hospitals, some 
self-insure or hospitalize through Blue Cross, and 
some provide only ont-of -hospital services. As 
might be expected, records kept and statistics de- 
rived from them vary greatly among the plans. 

"One of our early findings was (hat the 
population base, though 'built-in,' was not always 
available for statistical tabulations and particu- 
larly not when the population was to be classified 
by age and sex. The raw data were on paper some- 
where but not always easily accessible." 

Despite this limitation, he added, the rec- 
ords of such plans could be of value in, for ex- 
ample, comparisons with hospital outpatient 
clinics. Moreover, efforts are being made not only 
to broaden the amount of population-based in- 
formation but also to convince some plans (hat 
better record-keeping is important to them and to 
show them how to improve their records, 



Clinician Plays Key Role 

Dr. Wright, pointing to the interrelation- 
ship between hospital utilization and quality of 
medical care, suggested that "there is much to be 
learned by talking with representative physi- 
cians .... The person who is delivering the 
service is, after all, the one person who knows 
a lot of answers which you are trying to get in 
other ways. I would further suggest that no study 
or appraisal of the quality of medical care in an 
individual instance be considered complete un- 
less the individual doctor who rendered the care 
has had an opportunity to explain the circum- 
stances under which such care was given . . . ." 

Dr. White, on the other hand, stressed that 
physicians are not the "sole arbiters of what is 
good for the hublic's health." Many oilier pro- 
fessions are involved, as are "the consumers who 
are footing the bill and are more and more in- 
terested in the sorts of services they want and the 
level of quality they expect." 



"But Don't Forget the Patient" 

He examined the "assumption that the 
object of health services is to keep people out of 
the hospital .... If you accept this assumption, 
you get away from the idea that the bed is Hie pri- 
mary unit of medical care," He outlined several 
specific approaches that might open up if the 
focus of attention is shifted from the bed and the 
hospital to the patient and his complaint. 

In the same vein, Dr. Brotherston described 
the operation of the medical care system as "es- 
sentially a partnership of patients and doctors in 
relation to professional people and administra- 
tion." What is perhaps not sufficiently recognized, 
he added, is that the dominant partner is the 
patient. "The whole system goes into action sim- 
ply because of the patient's aggravation he 
presses the button and then the doctors and others 
jump about and do their stuff." But how good a 
job is the patient doing about recognizing symp- 
toms? And how much patient-perceived illness 
has no attention paid to it, by the doctor? Some 
sort of clinical checkup system, to bo \tsecl in spot- 
checking the population, would be highly desir- 
able, he said. 
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Proceedings 



TUESDAY MORNING SESSION 
January 22, 1963 



i.-'ii*- iui HIM u.'h in Hospital American Hospital Association, Chicago, 111,, at 

fi't H"-jnral ft.'-, MM'li and Kil- 9:;HJ a.m. Mr, George Bugbee, Director, Health 

f rii' Arfit'ii t ,in Ht'-pihi) As- Information Foundation, University of Chicago, 

' I",^ I'uliiii- Ili.ihh SCITI.T. Oiu'ugo, 111 , presided. 

If'tH nf Mitt'.. H'Md- 



OPENING REMARKS 

HI < 'If VfliM \N rliaiiinnn of the section, and members of the sec- 

, .: ..jii. r!."i..u. I uuuM ]>|;i. ro ( . tl ll tinn arc among those present. 
" ^-f .. '.f.-i To try lo survey the problem as chairman is 

.: ; -w v..(,r pn-jtiun- ui<l flu- li-r of pretentious, especially \vith this attendance; 
i-' ; :i> ' ' ^* n T|,I- il.ty -t'-inn on Kf- thei-efore, T will simply note a lew high spots. 
I H i' MI f '-*> You are all conscious of the great increase 

" n -". iht- IM nf rh.< ,. .itrt'iith'iiK- '" Ui-e ant ' pi'ice use of hospital care, medical 
' i."-; i ;.u-., i( f t f,,, n ,,f fj ]M , ( , muivnii'd c!irc i physician services, drugs, as well as price in- 

^ i 1 ' - '".'n^iir it-.Mi- 1 ! iii tin- health orejii>es in most of these services. 
'' <f i'U rln I- uuo li m' ,/f,j U - -nine re- The combination of increased use and unit, 

' ' '' i'"M-f"i u c. price in the medical care field has increased our 

' "" l !; " ! 'i" nu ' (lf ''"' rimiVmu'C if- expenditures from about 3.7 percent of OTOSS na- 

''^ ' -* inj4.i|f icM.ii.-Ij.lMit hopefully, tional product in (he late 1920's to a current 5.8 

<: ' ' " S ' "' "' '"'irl't IIHVC more informa- percent, with some $30 billion of total expendi- 

' ll " i ;' ! 7, ri ": f " l!tj ' t ' tt - tlires - This ing level of expenditures has 

- i. m). -vni^ K.-^ir,!! Study See- caused concern throughout the medical care field. 

^ F r CXampIe ' thB Voluntai 7 hedth ^encies are 

Dr. \\mte, u),o M Concerned over the effect of these expenditures on 



prepayment charges when they clear through gov- 
ernment for approval o increased rates. More- 
over, the public expresses its concern perhaps most 
articulately through various groups in labor and 
industry, as large purchasers of health insurance. 

Wo need lo know more about hospital use 
and its dimensions, particularly in planning hos- 
pital facilities and the number of beds required. 
The relation of use and quality of care is so inter- 
woven as to be inseparable, as will be clear in 
presentations given you. This was clear in the 
abbreviated transactions of an earlier meeting 
which were mailed to all of you.* 

We need better information for policy 
planning as we evaluate total national expendi- 
tures for hospital and medical care and as they 
affect action in relationship to participation by 
government. The hospital field and physicians 
have a job of either correcting faults or being able 
to defend present practices. This makes research 
pertinent. 

The University of Chicago, primarily for 
its alumni, had a 2-day symposium last month on 
"Where Is Hospital Use Headed?" Current 
opinion was reviewed and suggestions for control 
were examined. Out of that meeting one might 
select a number of questions. For example ; What 
is proper use? Is there a proper use? As will 
come out later, (here is broad variation in use be- 
tween our States and compared with Canada and 
countries in Western Europe. There is great 
variation in use and thus far no real explanation 
of differences or definition of proper use, 

One cannot look at hospital use without ex- 
amining medical care as it affects that, use and, 
further, the customs of (he population using care 
have great effect. 

Having had one brief review of research in 
the December Symposium, I think it is clear that, 
while we have learned some things from the re- 
search, there is more that we do not. know than has 
so far been answered. 

I need hardly say that research on hospital 
use in difficult. We still require research to develop 
methods. Illustrations from present or past 
studios indicate it is a costly type of investigation. 
I think that the field would generally agree that 



*r.H. Deimrtmcnt of limit li, EcTucatdcm, and Welfare, 
Public Health Service, Division of Hospital nncl Medical 
Facilities, "Research in Hospital Use," Public Henlth 
Service Publication No. 980-E-l, 1962, Washington, D.O. 
20201, 50 pp, 



not enough experienced people have been involved 
or interested. 

With that brief summary of a few points, 
I will call OH others. The hope of this Conference 
is that the people here and the people who read 
the transcript that will come from this Confer- 
ence will be stimulated in thinking about this sub- 
ject and will consider ways of producing 
information to shed light on what is one of the 
major unresolved issues in the health field. 

The program needs little explanation. It 
is clear we will have a series of presentations. To 
the best of my ability, I will give equal time to 
those on the program. We purposely left the pro- 
gram flexible as to time for each speaker since 
time should depend on your decision as to how 
long the discussion is productive. 

I would now like to call on representatives 
of the two organizations who have sponsored the 
Conference, the first individual being Dr. Joseph 
McNinch. 

T)r. McNinch. is a graduate of Ohio State 
University, receiving both his baccalaureate and 
medical degree there. Also he has a degree in 
public health from Johns Hopkins University. 
He has been editor of history of the Medical De- 
partment of the United States Army in World 
War II; Director of the Army Medical Library, 
now National Library of Medicine; Preventative 
Medical Officer iu the Far East Command; Com- 
mander of the Army Environmental Health 
Laboratory; Commanding General of the U.S. 
Armed Medical Service Research and Develop- 
ment Command. 

Dr. McNinch is Director of Research and 
Director of the Department of: Research and Edu- 
cation, American Hospital Association, and Direc- 
tor, American Hospital Research and Educational 
Trust, Chicago. 

I am happy lo present to you General 
McNinch. 



DR. JOSEPH H. McNINCH ; 

Mr. Chairman, Ladies and Gc-ntlemen and 
Distinguished Quosls: On behalf of the Hospital 
Research and Educational Trust, it is my pleasure 
to welcome you to this Con Perence on Research in 
Hospital Use sponsored jointly by the Hospital 
Research and Educational Trust of the American 
Hospital Association and the U.S. Public Health 
Service. 
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I particularly welcome Dr. J. H. F. 
Brotherston and Dr. J. O. F. Davies, who have 
come from Great Britian to participate in the 
Conference. Although the political concepts of 
medical care in the United Kingdom differ materi- 
ally from those in the United States, I am sure 
that many of the problems have much in common, 
I also want to welcome some guests from 
Canada: Dr. Murray Acker, Commission on Hos- 
pital Insurance, Saskatchewan Hospital Services 
Plan ; nnd Mr, John Osborn, Director of Research 
and Statistics, Department of Health and Welfare, 
Ottawa, Canada, 

Also, from Great Britain, we are privileged 
to have with us, Mr. Derek Tlarington-Hawes, Di- 
rector General, International Hospital Federation. 
I also want to express our appreciation for 
the opportunity to sponsor this Conference jointly 
with the U.S. Public Health Service. As we arc 
all aware, there is a role both for government and 
nongovernmental organisations, institutions, and 
individuals in the provision of medical care in the 
United States and studies relating 1 to the various 
problems concerned with this area. 

Your chairman mentioned the costs of hos- 
pitalization and the rising costs. One might 
wonder why we, in a Nation that spent $7.> billion 
for tobacco in I960, $2.1 billion for watches and 
jewelry and almost $1(5 billion for new automo- 
biles, would be so mu eh concerned with the cost of 
medical care in this country. However, totals and 
averages are often deceptive figures. 

The average annual family income figure is 
not of help to the single family with one-quarter 
of that average income. The average stay of be- 
tween 7 and 8 days in a hospital, at an average 
cost of $35 per day, has little meaning for thp 
individual who is hospitalized for 90 days, at a 
daily oost which far exceeds the average. 

Moreover, the modern short-term hospital 
is a valuable community resource and it is made 
much more valuable by the shortage of skills re- 
quired to provide all the services needed in the 
modern medical practice. Despite the many ef- 
forts to recruit and train more people in the skills 
required to ope rote this hospital, there seems little 
likelihood that shortages will be relieved or satis- 
fied for some time. Because of our many techno- 
logical advances, shortages of technically skilled 
and professionally trained personnel appear in al- 
most every field in our societj', 



A major purpose of the Conference is to 
bring together you who have been conducting and 
participating in studies of the several different 
possible approaches to a better understanding of 
hospitalization and the use of hospitals. It is our 
hope that through an exchange of information and 
subsequent free discussion that research in this 
important subject can be improved, that studies 
can be so designed to increase comparability with 
other studies, and that additional qualified re- 
searchers will become sufficiently interested in the 
subject that the volume of research now being done 
will increase and new ideas and approaches be 
developed. 

Finally, I want to acknowledge the conti'i- 
bution of your chairman. Many individuals have 
worked in preparation for this Conference; how- 
ever, nobody has worked any harder and any more 
diligently than has George Rugbee. Therefore, on 
behalf of one of the sponsors, I want to express my 
appreciation to your chairman for bringing to- 
gether this distinguished group of individuals and 
for preparing a program which, I think, will be 
highly beneficial. 

THE OH AIRMAN: 

Now, I would like to cull on Dr. Jack 
ITaMeiiian. Dr. ITahk'iiwn received his medical 
degree at Iho Uuivcrsily of Oklahoma ami his 
degree in public health fioni the Fni versify of 
Michigan He is a long-time officer in the Public 
ITeullh Sen ice, Mime '2\ yen is, wilh v.inerl admin- 
istrative assignments '! yeni'.s in research and, 
of course, (hoo of you \\lio know J:ick, know lie 
likes to talk about Jus U years in Alaska, where he 
developed the Arctic Health Research Institute. 

I .should like to now call on the Assistant 
.Surgeon General, who is Chief, Division of Hospi- 
tal and Medical Facilities, Dr. Jack 0. Haldeman. 

DR. JACK C. HALDEMAN : 

On behalf of the Public Health Service, I 
would like to \\elconie yon to this Conference. 
George Bugbee and Dr. McNinch made nay talk 
for me nnd, therefore, I am not going to repeat it, 
except to merely say that during the next two days 
I hope we will address ourselves largely to three 
questions: first, what studies are being conducted 
in the field of research on hospital use; second, 
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what studios should we be conducting; and third, 
how should we go about developing these studies ? 
I would like to reiterate only one thing 
that I hope, ns a result of this Conference, some of 
you who arc not now undertaking research in the 
general area ^of hospital research, will undertake 
to do so. I do not know any area in the Held of 
hospital research that should have a higher prior- 
ity ut this time and, certainly, we in the Public 
Health Service will give applications for grants 
in our extramural research program in this area 
a very, very high priority. 



THE CHAIRMAN : 

Many of you know Osier Peterson, Profes- 
sor in the Department o Preventive Medicine at 
the Medical School at Harvard, who was con- 
nected with the Rockefeller Foundation, concerned 
with organization of medical care and the quality 
of care. One of his outstanding studies concerned 
general practice in North Carolina. 

Therefore, it is a great pleasure to call on 
Osier. I will likewise request him to inl reduce 
Dr. Barsamian, his associate, at the proper 
moment. 



A PLAN FOR DISSECTING SURGICAL PERFORMANCE 



DR. OSLER PETERSON : 

Dr. Barsamian and I come from different 
fields. He is a member of the Surgical Faculty 
of the Medical School and is probably best de- 
scribed as the man who directs most of the research 
activities of the Surgical Service at Boston Hos- 
pital. He came- to work with us in the Depart- 
ment of Preventive Medicine a couple of years 
back. I think that at first, he, as a surgeon, wns 
rather skeptical about the medical care studies 
we were proposing. However, as we have worked 
together, \vo have both become increasingly inter- 
ested in a study that has also become increasingly 
complex. 

We had difficulty deciding who was going 
to do what today. It was finally decided, inas- 
much as I could read well and he could think well, 
that I would read the paper and Dr. Barsamian 
would discuss it and, answer questions later. Now, 
if they are ready in the projection room, I think 
we can begin. 

{Dr. Peterson illustrated his paper with 
slides.) 

In most countries hospital staff appoint- 
ments are given only to a small number of well- 
trained doctors. In the United States most doc- 
tors expect to have hospital appointments. This 
includes men with superb qualifications as well 
as others whose preparation is only a rotating in- 
ternship. (This is like a frosting it is thin and 
insubstantial and may disguise the substance of 
the cake itself.) 

In a population study performed several 
years ago, Odin Anderson found tha-t about one- 



half of the people who had had surgical procedure 
performed had been operated upon by surgeons 
certified by a surgical board or Fellows of the 
American College of Surgeons. It is only within 
the past few years that membership in the Col- 
lege has become difficult to achieve, so that even 
(ho value of this latter qualification is variable, 

A number of measures have been taken tc 
protect the quality of hospital care when the skills 
of the- staff arc variable. Among these are the ac- 
creditation process, the record review and tissue 
committees, and continuing educational programs 
The effects of these efforts are difficult to assess 
It seems likely that the time will come when hos- 
pital practice will be limited to smaller number? 
of highly qualified doctors, or alternatively, ef 
fective measures of performance will have to b( 
developed to determine competence of mdividna 
doctors whose qualifications are not the best. 

This study, which originally sought tc 
measure the effect of internship and residency 
training on clinical competence, led to the selea 
tion of surgery as its subject about two and one 
half years ago. Hospital surgery was chosen bo 
cause surgeons are required to write an operativi 
report, register a preoperalive diagnosis, and mosi 
important, much of their work produces a tissm 
which goes to the pathologist for a second am 
independent* diagnosis. 

There was a time when mortality rat&i 
probably would have reflected surgical skill, Bu 
antibiotics, blood transfusions, better equipment 
and better anesthesia have made surgery remark 
ably safe. Direct observation of the surgeon o 



late evaluation of the quality of survival of his 
patients were dismissed as impractical. It was 
decided, therefore, that the study would have to 
deal with material that could be obtained from 
hospital records. 

The population of operations for sampling 
is obtained from the operations register. Ap- 
pendectomies, cholecystectomies, and pelvic sur- 
gery have been found suitable for study because 
they are complex, serious, produce a tissue for 
pathological examination, and are performed by 
surgeons with all types of training. 

The responsible surgeons were grouped by 
yearly training intervals into four classes, the low- 
est of which had a year or less of training, and 
the highest of which had more than 4 years of 
training. There were great differences in the 
amount of surgery done by individual surgeons 
so that it was obviously desirable to sample each 
doctor class with the proviso that X number of 
vmtients of each doctor would be selected. 



Results 

The first two hospitals studied seemed to 
support the thesis that better training was associ- 
ated with better surgical cave. In hospital No. 1 
the normal appendices removed by the fully trained 
surgeons were about 15 percent of all primary 
appendectomies. Among minimally trained sur- 
geons this proportion was about 32 percent. In 
hospital No. 2 the gradient was almost precisely 
the same, but at a different level. Here the fully 
trained surgeons removed 8 percent of normal 
appendices while the untrained surgeons removed 
l(i percent. The minimally trained surgeon often 
failed to explore the common bile, duct when indi- 
cated in the. course of cholecys tec torn ies. The 
complications attributable to surgery (e.g., wound 
infection) were more common among the patients 
of the minimally trained doctors than among 
those of the 1 fully trained. Tlip well-trained 
.surgeon had to transfuse fewer patients who had 
pelvic surgery and trenernlly employed this im- 
portant therapy in more orthodox fashion than 
the minimally trained doctors. Pelvic surgery is 
a bloody operation the average loss is about 000 
cc. The performance of indicated laboratory 

was also related to (he doctor's training. 



There was also a hospital effect. The two 
hospitals were very different in many ways and 
the surgery performed may have reflected morale, 
competence of the chief of surgery, and other qual- 
ities which were not readily measurable. 

When the study was extended to hospitals 
No. 3 and No. 4, none of these relationships -were 
evident. Virtually all of the surgeons performed 
at a level compatible with minimal training. 

The pathology of pelvic surgery does not 
sort itself into precise categories labeled "normal" 
or "diseased" as do gall bladders or appendices. 
The- common benign growth, the uterine myoma, 
furnishes an example of the problem as well as 
the many processes available for study. Myomas 
are said to be present in about one-third of women 
beyond the age of 35, Most are small. They often 
produce no symptoms even when quite large. The 
diagnosis of this benign disease rests solely upon 
the findings at physical examination, Symptoms 
are irrelevant to the diagnosis. The severity and 
the duration of the symptoms normally deter- 
mine whether surgery is indicated, because an 
asymptomatic fibroid is operated upon only if it 
is increasing rapidly in size. The first process, 
therefore, that one studies is the severity of the 
symptomatology as a justification for surgery. 
Since the symptoms produced by fibroids are so 
uncertain, it is necessary to define the conditions 
under which they do cause, disease. These defini- 
tions follow : 

1. a submucous fibroid where (he sympton 
is bleeding. 

2. a single fibroid 5 cm. or greater in size. 

3. multiple small fibroids enlarging the 
uterus to twice normal size. 

4. a degenerating fibroid. 

5. torsion of a peduncnlated fibroid. 

If any of these are present, then pathology 
justifies the diagnosis. If there are no fibroids, 
the diagnosis is wrong. If the doctor describes a 
definitely enlarged fibroid uterus and a normal 
uterus is removed at operation, an additional judg- 
ment is possible that the doctor's pelvic exami- 
nation was not competent. If small fibroids that 
do not meet the size requirements stated above are 
present, the diagnosis is correct but is greater than 
or exaggerates the pathology. The permissible 
surgery for fibroids varies with the nature of the 
complaint. Symptoms may be sufficient or insufR- 



cient to justify surgery. If the symptom is ster- 
ility or frequent abortions, a myomectomy is the 
only permissible operation. If the symptom is 
bleeding, a dilatation and curettage is vital before 
further surgery is undertaken. Examples of sur- 
geons who omitted this procedure and failed to 
detect the hyperplastic endometrinm or the endo- 
metrial polyp which was the cause of bleeding are 
not infrequent. Hystei'ectomy under these cir- 
cumstances is the wrong operation. With many 
processes io examine, the probability is that doc- 
tors who do not understand all the issues involved 
in pelvic disease will reveal their uncertainty by 
what they do or fail to do. 

As part of the preparation Tor this study 
of pelvic surgery, logic graphs were consirucled 
outlining the relationships between symptoms and 
pathology for all the diseases commonly found in 
the surgical records of community hospit tils. With 
graphs to systematize the relationships between. 
symptoms and physical examinations and diag- 
nosis and of diagnosis to surgery and to path- 
ology, etc., it became possible to separate pelvic 
surgery into a series of discrete steps or proc- 
esses. * It is a well-recognized principle tlmt the 
aggregation of data is usually attended with a loss 
of information. Separating surgery into a aeries 
of steps or processes produced a series of related 
but different judgments. 

The series of processes studied are outlined 
in table I. The first process, the study of the 
clinical history, required the formulation of 
separate standards for different presenting symp- 
toms. The symptoms of pelvic disease are dis- 
orders o uterine bleeding, pain, masses increasing 
in size, sterility, and those such as incontinence 
and bearing down that arc related to relaxation 
of the pelvic floor. Table IT illustrates how the 
completeness of a history is scored in relation to a 
disease in which uterine bleeding is the presenting 
complaint. The first, essential of a good clinical 
history is that the presenting complaint be clear. 
To be clear a presenting complaint must identify 
a major symptom and its duration. If one or both 
of these bits of information is missing, the history- 
is scored as 0. If both are present, the history is 
scored 1. In any disease involving uterine bleed- 
ing the next question that would be asked would 
relate to the fact of whether the patient was pre- 



or post-menopausal, and if prc-menopausal, the 
facts relative to the menstrual cycle and childbear- 
ing. These, when present, raise the score to 2. As 
additional bits of relevant information are added, 
the score can be raised stepwise to 3 and 4. 

TABLE I. PROCESSES EVALUATED 

1. Completeness of clinical history by preopera- 
tive diagnosis. 

2. Completeness of physical examination. 

3. f^i-\-P l + L l = Da} ( Wo rkup== diagnosis) 

4. $,>+P s -\- ,...= fiii (Worlnip justifies surgery) 

5. Dw=P a (Agreement of diagnosis and pathol- 
ogy) 

6. Specificity of surgery 

7. Pci = Pa (Agreement of clinical pathology 
and pathology) 

8. Appraisal of tissue removed 

9. Postoperative care 
10. Complications 

TABLE II. HISTORY CODING RELATED 
TO UTERINE BLEEDING 

A. Chief complaint not recorded or SCORE 
identifiable. Mention chief com- 

plaint without duration. 

B. Mention chief complaint H- dura- SCORE 1 
lion. 

C. (B) plus: 

Premenopausnl PouPmenopawtal 



*Dr. Frank TCasierrtay mid Frank Ingersol, members 
of the Harvara faculty, gave much help In this work. 



1. LMP or negative 1. Mention Menopause 
pregnancy test, 

2. Duration. LMP or 
interval 

3. Flow (if major 
complaint, spot- 
ting) 

Married patients 

1. Children Two must be mentioned. 

2. Pregnancies 

3. Abortions SCORE 2 

The first half of the scoring procedure for 
the physical examination is shown in table III. 
This begins with the assumption that pelvic man- 
ual or rectal examinations are vital when pelvic 
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surgery is contemplated and should be recorded. 
In the absence of these examhmtions the physical 
examination is coded as and if the result of one 
is recorded, the score is raised to 1. If in addition 
to the pelvic and rectal examinations there is an 
examination of the abdomen for tenderness or 
mafwesj the .scory is increased to 2. In similar 
fashion, the addition of other bits of important 
information that indicate that a complete exam- 
ination was done may raise the score stepwise to 
a maximum of 5 for a very complete examination. 
The failure to record information about the pelvic, 
icrt ul, and abdominal examinations produces a 
disproportionate number of very low scores in 
s-ome hospitals. While a good gynecologist should 
invariably do both a pelvic and rectal examina- 
tion, we have compromised this standard by per- 
mittmp: a doctor to score higher on this scale when 
only imp is recorded, if in addition there is evi- 
dence that the remainder of the examination was 
lawfully and completely done. Item "D" pro- 
vi<lif> for such a case. This is proper since it is 
jM^-iible that negative examinations may not be 
recorded cum though performed. 

TABLE III. PHYSICAL EXAMINATION 
CODING 

A. Pelvic manual or rectal examina- SCORE 
tion not recorded. 

Ii. Pelvic manual or ivctal cxamina- SCORE 1 
tion recorded. 

C. Pelvic manual examination ~ SCORE '2 

hpei-uluin oxiiiuinatinu 
liectal examination 
Abdominal examination for 

1. Ma^A 1 '-. 

-', Tenderni"-* or ha^in 



OR 

I). Pelvic manual or iwtal exjumim- SCORE i' 

nun rt ,-ixvtiium. 
Abflnmiiiiil examination for 

1. ."UapM-.s 

L*. TeiuK'rnt'^ or spu-m 

j. Liver ami spleen 
Tiv<i of the following 

1. Scars 

~'. Howl sounds 

3. C.V.A. T 

4. Hernia 



The next process studied is the relationship 
between workup and diagnosis process 3 of table 
I. It will be noticed that this is described as Si, 
PD etc. in contrast to the next process in which the 
relationship between workup and surgery is ex- 
amined where symptoms are coded as S 2 and the 
physical examination is P z . These different sub- 
scripts are given to S and P because the symptoms 
and physical findings that may be sufficient to jus- 
tify diagnosis may be quite different from the 
symptoms and physical findings that are adequate 
to justify surgery. 

TABLE IV. STEIN-LEVENTHAL 
SYNDROME (COMMON SYMPTOMS) 

SYMPTOMS: 

A. Age under 30 years. 

B. One of the following: 

i Amenorrhea 

ii Oligomenorrhea Duration 

iii Irregular intervals Si 4 years S 2 
iv Sterility if married Duration 

no children 2 years 

Si =iS(H-^i (for workup=Dx,) 
S z ~S 2 -\-A (for workup surgery) 
LAB: 

i D & C shows secretory endometrium = 
ii D & C not done ~ 

iii D & C shows other 

PHYSICAL EXAM: 
i Bilaterally enlarged ovaries 
ii Normal or not done 

Unilateral ovarian enlargement 
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In table IV, the common symptoms of the 
Stein-Leventhal Syndrome are listed. This rather 
uncommon disease is shown because it is suffi- 
ciently simple to serve as an illustration. Patients 
with this disease are normally young and complain 
of amenorrhea, oligomenorrhea, irregular menses, 
and, if they are married, of sterility. The critical 
physical findings in this disease are bilateral en- 
larged ovaries. These large ovaries have a thick 
capsule that may be related to the failure of ovula- 
tioii and the sterility and menstrual disorders for 
which the patient seeks attention. These patients 
are sometimes obese and show increased hirsutism. 



Since these latter symptoms may or may not be 
present, they are of no value in decision-making 
and are, therefore, omitted. It is necessary to de- 
fine symptoms which may be adequate for a diag- 
nosis and others which are adequate for surgery. 
The presence of scant menses with bilateral en- 
larged ovaries in a young woman are sufficient to 
justify a diagnosis. Because menses are often 
slow in being established and because some women 
with Stein-Leventhal disease ovulate rarely and 
hence may not be completely sterile, evidence suffi- 
cient to establish the diagnosis is not enough to 
justify the operation. Hence, before surgery can 
be justified one can conservatively demand that 
the menstrual irregularities must be of at least 4 
years' duration or that sterility must have been 
present for at least 2 years before surgery can be 
justified. 

Under laboratory is included another vital 
bit of information. Women with this disease are 
sterile because they fail to ovulate. Before sur- 
gery is contemplated, a gynecologist could deter- 
mine the fact of ovulation or nonovulation by 
having the patient keep a temperature record. 
Since no evidence relative to this simple examina- 
tion has been found in any patient records studied, 
it seems fair to ask that similar information be ob- 
tained by curettage. This is particularly true 
since all pelvic surgery should normally he pre- 
ceded by a curettage of the ondometrium. As can 
be seen, if the endometrium is secretory, this is 
coded as L since this finding is incompatible with 
the diagnosis, because it means that the patient is 
ovulating. Under the physical examination the 
bilaterally enlarged ovaries that are the hallmark 
of this disease are coded P+. 

Table V, shows the logic graph from which 
the programer works. It can bo seen from lines 
A, B, or that, if the symptoms or physical find- 
ings or the laboratory are negative, neither the 
diagnosis nor the surgery is justified. From line 
D it can be seen that, if the symptoms are positive, 
the physical findings characteristic, and the ondo- 
metrium in appropriate stage, the diagnosis is 
justified. In line E, JS 2t the characteristic symp- 
toms with a defined duration, has been substituted. 
If 8 is positive, together with P+ and + , the 
diagnosis is correct and surgery justified. If any 
two of this triad (tf, P, or L} are positive and the 
other is not recorded, the diagnosis is only possible 
and surgery doubtful. 



TABLE V. STEIN-LEVENTHAL 
SYNDROME (LOGIC GRAPH) 



Sx 



A. 
B_ 

C_ 
D_ 

E_ 



S 



Pa; 



P- 



L- 



Lab 
(D&C) 


Workup = 
Dx. 


= Workup = 
Surgery 




No 


No 




No 


See ovarian 




No 


cyst. 
No 



P+ + 



Yes 
Yes 



Yes 



If two of the triad (S, P, or L) aro positive and 
the third is not mentioned, Dx Possible ; 
Surgery == Doubtful, 

Although the Stein-Lcvenllml Syndrome 
is a poorly understood disease, it is a discrete en- 
tity so that a diagnosis determines accurately 
what the expected symptoms, physical findings, 
and laboratory studies will be. If the preopera- 
tive diagnosis were sterility (and this is normally 
the reason for operating upon women with Stein- 
Leventhal Syndrome), this would not bo a precise 
diagnosis since sterility is a symptom that may be 
caused by many different diseases. Similarly (here 
are many identifiable causes for uterine bleeding 
such as an endometrial polyposis, cancer, and 
aclenomyosis. Many preoperative diagnoses are 
vague or merely a reiteration of a symptom such 
as uterine bleeding. Quite clearly the adaptation 
of a logic system to vague or symptomatic diag- 
noses presents special problems. Equation III, 
workup = diagnosis, of table I can only bo coded 
as "no" since there is no diagnosis. 

An attempt has been made to determine 
in the face of a vague or symptom-diagnosis 
whether workup justifies surgery. If the pre- 
operative diagnosis is a symptom such as uterine 
bleeding, the indications for surgery can be deter- 
mined only if the logic system examines the symp- 
toms and the physical findings in relation to all 
possible diagnoses that might cause bleeding. 
Constructing logic graphs for this situation has 
been one of our most onerous and tedious exercises 
in formulating this study. This process also flirts 
with computer diagnosis since the system seeks to 
find a diagnosis which fits the symptoms and 
physical abnormalities recorded. 

In table I the fifth process listed is "agree- 
ment of diagnosis and pathology." This is shown 
in table VI. If the diagnosis was Stein-Leventhal 
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FABLE VI. STEIN-LEVENTHAL SYN- 
DROME, AGREEMENT OF DIAGNOSIS 
AND PATHOLOGY 



PATHOLOGY SHOWS 

Thickened Capsule, Bi-' 

lateral 

No Corpus Luteum 
Corpora Albicantin Rare 

or Absent 

No Capsule 

Corpus Lnteum Present 

Coi-pora AlbicEintia not 

Rare 



Characteristic of S~L 
Syndrome (Code 4) 



Not characteristic 
of S-L Syndrome 
(Code 1) 



TABLE VII. STEIN-LEVENTHAL SYN- 
DROME SPECIFICITY OF SURGERY 

Bilateral Wedge Resec- Adequate (Code 4) 
tiou : 

Unilateral Wedge Re- Too limited (Code 3) 
section : 

Oophorectomy, unilat- Wrong (Code 1) 

eral or bilateral, with 
or without hysterec- 
tomy or hysterectomy 
alone: 

Syndrome and the pieces of ovary removed are 
normal ovarian tissues, the diagnosis is obviously 
not in agreement with the pathological result, 

Item 6 in table I, the specificity of surgery, 
seeks to define whether the correct operation was 
performed. For example, a hysterectomy awl 
oophoreetomy performed where the only path- 
ology is a benign ovarian cyst, is surgery that i* 
too extensive. Some ovarian cysts are found in 
both ovaries as is the case with the dermoid. Since 
a dermoid is benign, the only surgery required is 
excision of the cyst. If tho whole ovary is re- 
moved, this is too extensive, unless the ovary has 
been totally replaced. Since about 20 percent of 
dermoids are bilateral the record should show evi- 
dence that the second ovary was inspected or biop- 
sied at operation. If this is not done, the opera- 
tion is coded as too limited. 

In table VII, grading of specificity of sur- 
gery in the case of the Stein-Levcnthal Syndrome 
is shown. In this disease n wedge should be re- 
'noved from each ovary, No other surgery is in- 
'icnted. If only one ovary is done this would be 



too limited and anything else would be wrong 
since it would be likely to compromise the pa- 
tient's possibility of childbearing. It is strange 
to note that patients have occasionally had a hys- 
terectomy when their complaint was sterility! 

Since the clinical pathology as recognized 
by the doctor at operation determines the surgery, 
an examination of the agreement between the clin- 
ical pathology and the microscopic pathology is 
an important test of the doctor's judgment. It is 
apparently a normal human characteristic to ex- 
aggerate the extent of pathology at operation. 
However, recognition of the essential nature of the 
pathology at this critical time is a real test of the 
doctor's skill. In the Stein-Leventhal Syndrome 
(tie ovaries are characteristically large and pale. 
Operative descriptions of Stein-Leventhal ovaries 
which the pathologist described as normal clearly 
indicate that the surgeon was not sufficiently ac- 
quainted with the appearance of these ovaries in 
situ. 

Other procedures studied (Nos. 9 and 10) 
deal with complications attributable to the sur- 
geon and postoperative care. The fact that pelvic 
surgery is extensive and bloody and associated 
with frequency complications, presents many op- 
portunities for study. For example, if a patient 
suffers shock or serious blood loss at operation it is 
fair to ask that a postoperative hemoglobin be 
obtained. If the patient develops a wound infec- 
tion it is fair to demand that therapy be. guided 
by culture and sensitivity tests. Tims it is possible 
to build up a profile of the postoperative care thai 
can be described numerically in terms of good, 
fair, or poor. Complications are coded by their 
gravity as death, major, and minor. 

This outline for the study of pelvic surgery 
did not spring from someone's brow full-blown. 
At first, performance as judged in the record was 
graded as good, fair, or poor. These judgments 
were not reproducible. It became obvious that 
the processes that made up the performance had to 
bo dissected and rules for judgment clearly de- 
fined. The decision was therefore made to outline 
in great detail each step on the logic graphs of 
surgery in such a fashion that the process about 
making decisions as to the appropriateness of di- 
agnosis or of surgery could be programed for a 
computer and thus eliminate the continuing hu- 
man variation. This was a commitment to do an 



enormous amount of work because of the com- 
plexity of symptoms and the variable physical 
abnormalities recorded for half a dozen common 
pelvic diseases to say nothing of the variable ( reat- 
ment possibilities.* 



Medical Records Incomplete 

Frequently the physician or surgeon knows 
a considoral >le amount of medical history about his 
patient which is not recorded. In the ease of pel- 
vic surgery, it is quite clear that social factors 
often play a large part in the decision to operate, 
although these are not normally recorded. For 
this reason as well as in the interest of being fair 
to the doctors whose records are studied, the cri- 
teria which are established as sufficient or insuffi- 
cient to justify surgery should err on the side of 
being generous to the doctor. This will increase 
the certainty that a diagnosis that is described as 
unsubstantiated or surgery as unjustified will in 
fact be so. On the other hand, when this logic 
system says that a diagnosis is justified or an. 
operation indicated, this statement will be made 
with substantially less certainty. This is proper. 

The large amount of work required to pro- 
gram surgical practice for a computer cannot bo 
justified merely as a convenient research tool to be 
applied to a few hospitals. It is proposed to use 
this fool, which is now virtually complete, to first 
study an area wide sample of pelvic operations. 
This should help determine the extent of the two 
influences of hospital and of surgeon-training 
upon the performance of pelvic surgery. Later, 
this type of study programed for a computer may 
possibly be adapted to take over some of the func- 
tions of a tissue or record review committee in 
hospitals, 

I hope now you will have questions so that 
Dr. Barsamian can at least illustrate how the sys- 
tem works. 



DK. ERNEST M. BARSAMIAtf : 

"First of all, let me say how happy I am to 
be here in a group quite different from my usual 

"Dr, George V, S, Smith gave extensive help In the 
formulation of this portion of the study. 



associations. However, I do not want to apologize 
for my presence here because I believe it is useful 
for people who work with patients to occasionally 
intermingle with a group such as yours, in order 
to expose you to their point of view. 

The reason we went to all this trouble (and, 
believe mo, it was a lot of trouble) is because we 
are convinced that no one individual or group of 
individuals can, by simply taking a chart and 
looking at it, evaluate the care as recorded in that 
chart as good or not good, and be repeatedly con- 
sistent in their judgment. Unless there is a 
method, employing a computer to make evaluation 
reproducible and to assure objectivity, questions 
will always arise about the validity of the answers. 

Again, we think that a whole chart, which 
is really a composite of processes of medical care, 
cannot be graded unless it is dissected into its 
component parts with each part considered sepa- 
rately for study. This tedious method is essen- 
tial if wo want to be certain of the standard of 
medical care given by a specific doctor, hospital, or 
country. 

Indices such as infant mortality and length 
of life certainly do not give us the whole picture 
of medical care. Our method provides more in- 
dices to complete the picture of evaluation of sur- 
gical care. Only after arriving at a sfanclard of 
judgment which is reliable and uniformly appli- 
cable can we compare it with standards of of her 
countries, or against what we think is the ideal. 
At the same time, by dividing this evaluation into 
10 categories we can determine where the defi- 
ciencies in care lie. We have to know which link 
of the chain is weak in order to strengthen it, 

Now, the other side of the coin, as Dr. 
Peterson mentioned, is Hie problem of policing 1 
the admission privileges which doctors have in 
hospitals. As you know, admission privileges are 
given out faii-ly generously in the United States 
as contrasted with the situation in Sweden, for 
example. Therefore, policing within United 
Stales hospitals must 'be very critical. Some of 
the present efforts in this direction, however, are 
nob free from subjective bias. For example, a 
doctor who is a member of the tissue committee in 
a particular hospital could not help being biased 
in his medical judgment of a friend who is the 
responsible surgeon. On the other hand, a com- 
puter can evaluate the operative procedure much 
more objectively because essentially it is a force 
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outside and apart from the hospital which makes 
the judgment. 

The question also arises of comparing per- 
formances within a given hospital, for example, 
those of the trained with the nontrained surgeon. 
We want to know if surgery is done equally as 
well by the family doctor as by the fellow who 
has spent 4 years in surgery. We think not, but 
there is no conclusive evidence that this is so. We 
cannot prevent the family doctor from operating 
on a patient because we feel he will not do as good 
a job as a well-trained surgeon. However, if 
there is good evidence to show that only the well- 
trained surgeon should perform surgery, the pub- 
lic can be informed accordingly, We feel that our 
citizens should get the best medical care, and tints 
we must provide an answer to this that is both 
objective and highly accurate. 

On the other hand, if we find that the 
trained surgeon is doing work at the level of the 
family doctor, then, of course, we will have to go 
back to the' people who set up the standards of 
surgical training to find out what is wrong with 
our training programs. 

There are many other questions, such as the 
influence of the medical school on the end product, 
the influence of the hospital training program, 
the influence of the student's family background, 
and his degree of intelligence, which can all be 
answered once objective judgment of the medical 
or surgical care record is achieved. 

A form has been constructed for classifica- 
tion of doctors by specific criteria. By means of 
a simple check! ist, doctors can he classified by such 
criteria as length of training, medical school at- 
tended, grades obtained, and type of hospital 
where training was obtained. All kinds of ques- 
tions can be immediately answered by merely 
changing the classification, at the top of the page, 
since the framework of evaluation of care remains 
the same. 

If you are going to devote time and energy 
to doing all this work, it is important to follow 
through on the study. Of course, if you only 
plan to obtain the results for one or two hospitals, 
this would be a very good way to waste time. 
However, we planned this as a tool to be applied 
on a broader base than has been done .heretofore. 
Now, I think the best way to proceed from 
-his point is to answer specific questions. 



DISCUSSION 

MR. MURRAY CLUTCH (California 
Medical Association) : 

Dr. Peterson mentioned there were signifi- 
cant differences in hospitals Nos. 1 and 2 but not 
in Nos. 3 and 4. Have you attempted any rela- 
tionship in trying to determine the medical 
education, postgraduate training, the place of 
internship and residency in Nos. 3 and 4 as against 
Nos. 1 and 2? Have you established anything? 

DR. ERNEST M. BARSAMIAN : 

The results which we have had thus far 
were based on our previous method of subjective 
evaluation. This is not the way to do it. There- 
fore, we have sent all of our information to the 
computer and hope soon to have the complete 
results. 

We have impressions about various things. 
We have records of the doctors' training, their 
background and so on. However, I think it best 
not to hazard a guess at the present time lest I 
give you impressions that the computer will not 
support. 

MR. WALTER J. McNERNEY (Blue 
Cross Association, Chicago) ; 

In this approach, what is the correlation 
to the activities of the Tissue Audit Committee? 

DR. ERNEST AT. BARSAMIAN: 

The Tissue Committee performs one of the 10 
processes which we have 'included here. How- 
ever, we have tried to be much more definite in 
this than the Tissue Committee. 

I am glad you brought up, this question be- 
cimse I would like to illustrate it. In certain 
diseases a diagnosis may be made which indicates 
surgery; if the diagnosis is correct, it will agree 
with the pathology, and the committee will 
approve. 

Let us take, for example, a diagnosis of 
gangrene of the bowel. This diagnosis by itself is 
an indication to operate. The diagnosis of ap- 
pendicitis is likewise an indication for surgery. 
However, removal of the appendix, if it is later 
found to be normal, was based on an error made 
in rendering the diagnosis. 

On the other hand, there are other diseases 
which cannot be judged in this way, that is, in 
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terms of diseased or nondiseased tissue. This was 
mentioned briefly by Dr. Peterson. For example, 
an individual may have a small cyst on the ovary, 
which occurs every month. Sometimes it may 
become a little larger and cause a bit of discom- 
fort. If this is diagnosed as an ovarian cyst, this 
diagnosis is NOT an indication for surgery. If 
upon removal of the tissue, pathology such as a 
follicular cyst is shown, the Tissue Committee will 
say the surgery was justified. However, we say 
it is not, because indication for surgery is not based 
solely on palpation of an organ that is not per- 
fect you are not attempting to correct anatomy 
you are attempting to keep a patient well. There- 
fore, the Tissue Committee does a fraction of what 
this study intends to do. 

ME. E. G. JACO (School of Public Health, 
University of Minnesota) : 

Do you plan to use or correlate the type of 
surgical scores with other types of medical care 
in the hospital or police it in another way so that 
there is a correlation between surgical care and, 
say, medical or pediatric or obstetric or any other 
type of care also going on in the same hospital ? 

DR. BAESAMIAN: 

At the present, time we do not plan to do 
this because we feel we are busy enough attacking 
the problem of surgery. However, we hope that 
at a future date this particular problem will he 
tackled. 

From the subjective evaluation of those hos- 
pitals, it appears that medical training is also re- 
lated to such things as better nursing care, labora- 
tory tests, etc, These are things WB want to 
complete as a support or in addition to getting an 
overall look at the other departments. This would 
then pinpoint the hospital effects as well as the 
doctor effects. 

ME. VERNOK WECKWERTH (Uni- 
versity of Minnesota) : 

In attempting to follow through on the 
notations you were using to find out this system, 
which apparently is a summary of scores, kind of 
matching the lower bounds of some kind in the 
computer, I was confused by the use of the plus 
sign. Can you explain this. There are two uses 
of the symbol "plus," One is to indicate the 
presence of a particular condition and, in lines 3 



and 4, I don't know whether that means 

a comma in between. Can you explain that? 

cannot tell whether this is an equation or codi: 

system. 

DE. BARSAMIAN: 

The symptom "plus" stands for u anr 
You need both symptoms and a physical examin 
tion to justify the diagnosis. If the symptoms a 
present and the physical examination shows sot 
pathology, then both the symptoms and the p 
thology should justify that diagnosis. 

The symbol ^ indicates the symptoms tli 
are necessary for making the diagnosis and the 
are not necessarily the same as the symptoi 
necessary to justify surgery. 

ME. VERNON WECKWERTH; 

You have a letter "a" which I do not raids 
stand. 

DR. BARSAMIAN: 

That, was supposed to bo a capital U A 
which means that all the patients should be und 
ags 30. 

MR. VEENON WECKWERTH : 

Therefore, these are not equations, they ti 
definitional categories that the presence of 
is equal to the presence of 8, plus the fact that t 
person is under 30 years of age? 

DR. BARSAMIAN; 

We are defining $i hero as Si which is o 
of those Jour in the parentheses here, plus the ft 
that the patient is under ago 30. If the patient 
over ago 30, then she would not bo placed in tl 
diagnosis. However, the two arc necessary, 
suppose the recording of both of these as /Si 
confusing. The idea, however, ia that this is 
equation. It indicates that m\ ago of leas than 
plus one of these symptoms are necessary to ma 
the symptom /S, a symptom that justifies t 
diagnosis. 

ME. YERNQN WECKWEETH ; 

On the left hand side, the plus men 
"present" and on the right aide it means "and,'' 
that right? 



That is right. 

At the same time, .*?, is really ff, plus the 
duration of 4 years for those three symptoms and 
'2 years for the induction of Merility, This just. 
ivhVrH my ignorance in the use of these symp- 
toms. Being a clinician, however, T should Imve 
probably n-.t>d j-ompthing el c e and avoided this 
i'<muum. 

Dlt.PKTKRSOX: 

That point is \u-II taken. I did not see the 
-4idftbut thank yon very much 

THE CHAIRMAN: 
Aie there nther fjue-tions? 



One other <me-t ion k the abruption made 
rh:it thf p;tfholo<ri-t is cornet J Tt appears that 
)lif ju-hH<Mti<m or fin:il division that you arc niak- 
mir !> tliaf rhe clinician i- wron<_r if the pathologist 
dws nof !ii.TM> with liim. Is thai f-orrent? 

DR.HA11SAMIAX: 

No. v.c did nnt mean to convey tlv.it impros- 
-linn, I think (tic p:ithologi-f is right ulion he 
'SINS uftiT Ifwkinu ;it tin- utmi-. and find lug a 
irbhud, that their is a fibroid However, (lie pa- 
tholn^i-t rvrt'imly dm 1 - not know whether or not 
Hii'jA'ry \v.i> indicitr'd, Thii i-, why we do not 
think that the Ti-Mtr ( YmimitH-t' alone is < n apahle 
of iUHWi'i'iDi; tin* qtie-tiniis w have, \V> mn--t jro 
luck to the pin<v-N nf \\oiknp indi-'alinir -mj/cry. 
Thi^ dtvs nut r^rAtf to \\hnt the jtAtliolniri'-t find- 
J^<MII-P \\o r,tn ^onii-fiiiifs a-iive that worlaip iu- 
VnMtt'1 ^iirL't'i-y on ihc luti*. of uliat we knmv and 
Eo.s.-li, hut (he p-ifh'tlojri-f may not conic up with 
iiluit v. t expe.-t him to. AVeare attemptinirto fol- 
hm tlie thoughts of the Mirtrenn from tlie moment 
rht> patient i-itdmiih-d to thefnneheisdi^rii.u-ired 
from tin* ho.piml, T}u-e tiling citnnot be looked 
ur ri'troirre-Jveh- ht'c.ms-p this will always make 



MR. UKKXAUl) KKAMKK (Tufts Uni- 
r^ity, ItiKtnn) : 

Then nhat you have developed here is a 
fp of thinking and a Myle in relation to a style 
l.u*iiv. IfoHvivr, H?,.K Z noiiW like to know 



is whether and to what extent this style of think- 
ing indicated by theso 10 points is consistent with 
the training and education that, people undergo. 
My opinion is that you art) asking that, people per- 
form in a certain way, which is consistent, with a 
standard that you have set up. Would you expect, 
that some of the differences between performance 
and those proposed standards are attributable to 
some inadequacy in the teaching and training foi' 
these standards? If, for example, you had two 
experimental groups, one which has learned this 
style of thinking and one which has not, would 
you expect to get differences in actual perform- 
ance? 

DR. BARSAMIAK; 

I think I can answer all of that. I happen 
(o teach students the techniques of history taking 
and physical diagnosis. The standards we have 
set up for this study are far below those which I 
use in grading my second-year students in physical 
diagnosis. "We think this is only fair because parts 
of the examination or findings might be omitted 
from the patient's record. Aside from this there 
aw other difficulties in judging records. Our im- 
pression has been, of course, that important find- 
ings are seldom omitted from the record. If any- 
thing, however, doctors tend to exaggerate the 
symptoms and the physical findings. 

For example, (lie recording of a uterus as 
"'slightly enlarged on pelvic examination" gen- 
erally means that the uterus is normal. "We have 
found thi lo lie consistently true. Further, "ex- 
re-si vt- bleeding'' usually means some bleeding. 
This is determined by later checking the hemo- 
Tlohin. Therefore, these tabulations can be made 
in any way desired, and, as you said, the standards 
are only as good as the people who make them. 
However, the advantage is that they apply to 
everyone and are reasonable, because we did not 
attempt to have them include anything that could 
he regarded as controversial. There are lots of 
tiling in medicine upon which two people will not, 
ncrrep. There are certain things, however, upon 
which all people will agree and a few other things 
upon which more than 95 percent of the people 
agree. This is what we have attempted to adhere 
to. Since our standards exclude controversial 
points, if they are cut down any further, some of 
their essence will be lost v 

Everybody will agree, for example, that a 
pregnant uterus is not a uterus that should be re- 



moved by surgery. Everyone agrees that a polyp 
found in the cervix should he removed without 
opening the abdomen and excising the uterus fis 
well. 

On the other hand, there are certain things 
about which people will both agree and disagree. 
We will bend over backwards to let the doctor be 
considered right and be given the benefit of the 
doubt. Therefore, this technique attempts to 
avoid these discrepancies which can arise by vari- 
ation in standards. 

DR. PETERSON: 

There is another aspect to your question, a 
way of thinking or reasoning about surgery. This 
is not the way that this subject is taught at all. 
Indeed, if you examine the standard textbooks 
that cover this field, I don't think that you can, 
from them, deduce the theory of what is going on 
in this disease. Textbooks have nothing or very 
little to do with functions. It is almost impossible 
to find out how to think about this problem from 
the textbook. 

MK. RODNEY COE: (Medical Care Re- 
search Center, St. Louis) : 

You were mentioning cysts. A surgeon 
feels the cyst, and then he gets in there and he 
finds something. Suppose it is one type of cyst, 
it would then be worthwhile taking it out. There- 
fore, how can you determine on that basis whether 
the surgeon has to make his decision by not know- 
ing what kind of cyst it is ? 

DR. BARSAMIAN: 

As we have made a separate schedule for 
every particular disease involved in pelvic sur- 
gery, we have also worked out one in connection 
with the various cysts. We have done this after 
consultation with the Professor of Gynecology at 
Harvard, Dr. George Smith; Dr. Duncan Reid 
who is the Chief at Boston Lying-in Hospital, as 
well as with other members of the staff of other 
medical schools in Boston. The consensus is that 
a cyst of more than 5 cm. in diameter should be 
deemed suspicious. Cysts less than that size are 
rarely cancerous. Further, age makes a difference. 
Most of the malignant cysts occur after age SO, 
and suspicion of malignancy is not a factor in a 
patient under 30. The nodularity and tenderness 
of the cyst must also be considered. 



Now, a simple cyst, if it produces discom- 
fort or pain, will usually not lasfc more than a 
couple of months, nor will the disturbance- in 
menstrual bleeding which it will cause. There- 
fore, the discovery of a cyst that is 2 cm. in di- 
ameter, not tender, not nodular, or not in the sus- 
picious group, is not an indication for surgery. 
The cyst will usually disappear without treat- 
ment. The patient should again be examined 
after a period of at least 2 to 3 weeks, and if it 
has not regressed by this time the woman may be 
subjected to surgery. 

As I sny, this has all been delineated on 
paper. I will be glad to show you some of the lists 
if you are interested. 

DR. B. C. PAYNE (University of Michi- 
gan) : 

Most of the questions I had have already 
been answered. I was going to ask who developed 
the criteria, and I believe you answered that. 
Also, do you think that "schedules" for diagnoses 
other than uterine myoma, and now ovarian cysts, 
can bo developed for other diseases, other than 
surgical diseases particularly and, finally, does 
any of this apply to length of stay evaluation? 

DR. BARSAMIAN: 

We have developed lists for things such as 
dysfunction, uterine bleeding, cervical polyp, ret- 
roversions, so-called adhesions we have a long 
list covering everything except cancer, and we 
intentionally avoided this. 

The reason for staying away from cancer 
is that our only source of material for this is the 
operating-room book. We therefore cannot de- 
cide what surgery was not clone that should have 
been done. From the operating-room record, we 
do not know which patients needed surgery and 
did not have it. 

Now, this is not a limitation to the study be- 
cause sources of reference can be changed. Rec- 
ord-room rather than operating-room charts can 
be used first. However, there are still problems 
of controversy in the treatment of pelvic cancer, 
X-ray, surgery, etc. Thus, we have shied away 
from that and have attempted to include all other 
pelvic diseases. 

Now, as to length of stay. This is some- 
thing that we can compare later through use of 
the computer. 
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DR. PETERSON: 

I -would like to say that Dr. Burgess who is 
here in tlie audience, got a somewhat similar logic 
system for diagnoses of anemias, This, however, 
does not turn out to be terribly useful because 
there are not enough discrete anemics to make a 
very valuable study. However, if you are inter- 
ested, I suggest you talk to him. 

THE CHAIRMAN: 

Thank you very much, Dr. Peterson and Dr, 
Barsammn for reporting on a major venture in 
looking at the quality of medical care and its re- 
lationship to use. I think we will run into other 
ventures that go deeply into the medical side in 
several of the other studies. 

Our next presentation will be by Odin An- 
derson and Paul Sheatsley. They will report on 
a survey of patient and admitting physician 



opinions of a sample of hospital admissions in 
Massachusetts. This is a study in which some of 
us have been involved for an extensive period of 
time. "We hope it will be of interest to you as will 
also be the study methods used. 

Odin Anderson has been Director of Re- 
search of the Health Information Foundation for 
some 10 years. I have had the pleasure of work- 
ing -with him for the last eight. He took his 
public health work at the University of Michigan 
and is known to many of you. 

Paul Sheatsley is the Director of the New 
York Office of the National Opinion Research 
Center of the University of Chicago, and we have 
likewise worked with him for many years. Many 
of the studies in which this foundation has been 
involved have been joint studies with the National 
Opinion Research Center and with Odin. 

Now, Odin, do you want to take the micro- 
phone? 



A SURVEY OF HOSPITALIZED PATIENTS AND THEIR DOCTORS 



DR. ODIN "W. ANDERSON: 

While the Health Information Foundation 
was still in New York, prior to its move to the 
University of Chicago, we felt that some contri- 
bution could be made to the formulation of policy 
in the hospital and medical care field by a survey 
of hospital discharges in an area which has a well- 
developed hospital and medical establishment, 
rural and urban conditions, a range of occupations, 
and similar factors present in most areas of the 
United States today. Through a fortunate com- 
bination of circumstances mostly because of the 
willingness and cooperativeness of the Massachu- 
setts Medical Association, the Massachusetts Den- 
tal Association, the Massachusetts Hospital As- 
sociation, and the Bine Cross and Blue Shield 
Plans a survey of a representative sample of dis- 
charges from a representative sample of 50 gen- 
eral and special short-stay hospitals in the State 
of Massachusetts was started in 1960, and the field 
work continued into 1961. Because we felt that 
admissions of maternity patients to hospital were 
not at issue, we limited our survey to surgical and 
medical cases where the greatest possibility for 
discretion as to admission and discharge would be 
present. The hospital cases were drawn from the 
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50 hospitals over a 12-month period, to remove 
any seasonal variations in admission. 

Bach hospital was visited twice, at 0-month 
intervals, and a random sample of patients select- 
ed from the discharge sheets of the preceding 
calendar month. Patients were interviewed in 
their homes within a few weeks after discharge. 
Patients 18 years of age and over were interviewed 
personally, and for those under 18 an adult mem- 
ber of the household was interviewed on their be- 
half, usually the mother. In those cases where the 
patient was deceased } the closest responsible rela- 
tive was interviewed. The patients were asked to 
name attending and referring physicians, and 
these two physicians, if they were not the same 
individual, were interviewed as well. A total of 
2,355 cases were drawn from the hospital discharge 
records of which 2,046, or 87 percent, were inter- 
viewed. Close to 50 percent of the interviews were 
in the Boston Metropolitan Area. Forty-six per- 
cent of the interviews were in towns of 50,000 and 
over, 25 percent in towns of 100,000 and over, and 
11 percent in towns under 2,500. 

The patients and physicians were asked a 
detailed set of questions which would recreate the 
chain of events and decisions that led to the admis- 
sion and discharge. We know, for example, when 
the patient first became aware of the illness which 



eventually resulted in hospitalization. We know 
when the patient sought medical care after recog- 
nition of the illness, when the doctor recommended 
hospitalization after he had seen the patient, and 
the date of admission. We have detailed informa- 
tion on source of payment for hospital care, home 
circumstances, the type of practice of the doctors 
involved, family income, occupation, and so on. 
A few of the preliminary data will be presented 
today as a preview of much more to come. They 
will be limited to data from patients and to the 
period before and at admission. 



Profile of Admissions 

The annual admission rate per 1,000 popu- 
lation in Massachusetts ending in May 1961, ex- 
clusive of admissions for maternity, was 116. If 
maternity cases were added, the admission rate 
would bo in the neighborhood of 14fi. Massachu- 
setts is then among the States with relatively high 
admission rates. 

Massachusetts also has one of the highest, 
proportions of the population covered by hospital 
insurance of any State in the Union, approxi- 
mately 80 percent. The national average is now 
a little over 70 percent, Although no data by in- 
surance coverage will bo presented here, it is well 
to know that a very high proportion of hospital 
patients have all or part of their charges paid by 
insurance. 

By type of admission there were: Surgical, 
56 percent; medical, 42 percent; and other, 3 
percent. 

By type of accommodation there were: Pri- 
vate, 18 percent; semi-private, 43 percent; and 
ward, 39 percent. 

By length of stay 10 percent were one day 
or less, 2 percent the same day, and 10 percent 22 
days or longer. Five percent of the patients 
stayed 31 days or longer. 

The length of stay by type of accommoda- 
tion is of interest because of the differentials in per- 
diem charges : 



Private 

Semi-private 
Ward 



Percent with length o/ stay 
of 22 clays or longer 

9 



The distribution by time of day of admii 
sion has not been obtained before to our knowledg 
and gives some indication of the nround-the-cloc 
activity of the general hospital as far as externa 
demands made on it are concerned. 

7> percent- of the admissions took plac 
between 9 a.m. and 6 p.m. 

8 percent of the patients were admitiei 
between p.m. and 6 a.m.; 3 percent froi 
midnight to 6 a.m. 

16 percent were admitted during the 12 
hour period from 9 p.m. to 9 a.m. 

(Remember that these figures exclud 
maternity patients who have a habit of beinj 
admitted to hospital at odd hours,) 

In other words, projecting the 3 percen 
admitted between midnight and 6 a.m. to a] 
admissions in the State approximately 18,00 
nonobstetricol patients were admitted to hospital 
during that period of the 24 hours of the day. 

Hospital discharges are more concentrate 
in a- shorter time span than admissions. Ninety 
one percent were discharged between 9 a.m. am 
6 p.m. and 85 percent from 9 a.m. to 3 p.m. Thro 
percent ware discharged between p.m. and 
a.m. a seemingly odd hour to go home. 

The days of admission and discharge ar 
of interest to hospital administration, to indicat 
the distribution of patient-load during the weeli 
How closely do admissions and discharges coi 
respond to the 6-day work week? The answer i 
"somewhat." There were more admissions o 
Monday than on any other clay ; fewer admission 
on Friday and Saturday, rising again on Sundaj 
In fact, the percentage of patients admitted o 
Sunday is the same as the percentage admitted o 
Wednesday.. 

Naturally, the proportion of patients dig 
charged by each day of the week was the obvers 
of the admission pattern by day of the week. Pa 
tients were more likely to be discharged on Satui 
day and least likely on Monday. 

Assuming the mean proportion of admig 
sions each day of the week as 14 (7^ 100=14.3) 
the range was from 18 for Monday to 8 for Satui 
day, Assuming a similar mean proportion fo 
discharges, the range was from 9 for Monday t 
20 for Saturday. For those who would like to se 
each day of the week the same as the average fo 
the week these data show the bulges. 



Reasons for Admissions 

Among the total number of admissions (N= 
2,0-16) , 89 percent were tine to illnesses and 11 per- 
cent to accidents. Among the accidents (N"=219) : 



Motor vehicle accounted for. 

At work 

Home 

Other 



Percent 
25 

18 
29 

28 



Same-day emergency admissions, including 
iicci dents, accounted for 32 percent of all admis- 
sions (]S T =661). It is thus seen that one-third of 
the admissions (excluding maternity care) require 
round-the-clock standby facilities and personnel, 
i.e. handling of crises routinely. If we wish to add 
maternity care to the total of admissions, about 
45 percent of all admissions are then on a standby 
basis. 

The one-third of all admissions which had 
been admitted as emergencies were first examined 
by a physician at the following places: 



Office __ 
Home __ 
Hospital 
Other __ 



Percent 

16 

33 

48 

3 



Among the emergency admissions examined 
at the hospital (N-31S) : 

12 percent were seen at the clinic 

65 percent in the emergency department 

23 percent after admission to a bed 

Returning to the total number of admis- 
sions (N"~2,04(>), the main reasons for hospitali- 
zation, as given by the patient, were ; 

Percent 

Operation 44 

Treatment 27 

Tests or X-ray 25 

Others 2 

Unknown . 2 

The 25 percent who were admitted for tests 
or X-ray must he examined carefully. This was 
reported by the patient, and it is difficult to know 
whether or not the patient could differentiate be- 



tween an admission for treatment, i.e., nonsurgical, 
or for diagnosis. 



Patients' Feelings and Attitudes 

The last section of this presentation will 
deal with the patient's feelings and attitudes re- 
garding his illness and going to the hospital, add- 
ing an important human dimension to the objec- 
tive situation described in the foregoing. 

Patients were asked (or on their behalf) : 
"Back when you had the first signs of the illness 
which led to hospitalization, did you see the doctor 
right away or wait awhile?" (N=l,777, excluding 
same-day hospitalizations) : 

Percent 

Right away 47 

Waited awhile 49 

Don't know 2 

Signs discovered by doctor 2 

Patients who waited awhile were asked why 
they did so instead of seeing the doctor right 
away : 

Percent 

Financial 3 

Too busy 4 

No doctor readily available 4 

Thought it would go away 

Did not think important 35 

Fear 4 

Doctor could not help 1 

Distrusts doctors , 3 

Miscellaneous 4 

Don't know . 4 



Total (because of some overlapping) 106 

Of those who delayed seeing a physician, 
almost 80 percent gave us their reason that they 
did not believe their illness was serious enough, 
find only 3 percent of the patients mentioned finan- 
cial reasons. 

To get some idea of the role of pain and dis- 
comfort in motivating people to see a doctor, the 
patients were asked (excluding those who were 
admitted as emergencies) : "How much pain and 
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discomfort did you have just before you saw the 
doctor?" (N=l,38&) : 

Percent 

A, great deal 26 

Quito ft bit 27 

A little 22 

None 24 

Don't know 1 

Fifty-three percent, then, had an appreci- 
able amount of pain, and 46 percent little or none. 
"We do not know how to interpret this gross tlu'csh- 
old of pain before seeing a doctor, but it does 
seem to us that immediate pain is only one of the 
elements that is important in taking the patient 
to the doctor. There may have been pain in 
the past, but only one-half of the patients experi- 
enced immediate pain. 

Further, in addition to the question on pain 
and discomfort the patient was asked: "Before 
you talked with the doctor, how serious did you 
think your condition was?" (N= 1,385, exclud- 
ing same-day admissions) ; 

Percent 

Very serious 10 

Somewhat serious 32 

Not really serious 42 

Don't, know 7 

Again over 40 percent of the patients saw 
a doctor although they did not believe their con- 
dition was serious, but it ultimately resulted in 
hospitalization. 

Continuing the same line of questioning, the 
patients were asked: "Were yon able to keep up 
your usual activities at that time, or did you have 
to cut, down on some tilings, or wore you sick in 
bed?" (N = 1,;J85, excluding same-day admis- 
sions) : 

Percent 

Could keep up activities 44 

Cut down some , . 35 

Sick in bed 21 

In other words, 44 percent could keep up 
their usual activities, but 56 percent were disabled, 
among whom 21 percent of the total patients were 
already sick in bed at the time they first saw their 
doctors, 

The patient was asked how strongly the 
doctor fell about the need for referral to hospital 



at the time he first recommended it "Did 1 
feel it was absolutely necessary for you to go inl 

the hospital, or did ho think you would be muc 
better off, or did he just feel it might be a goo 

idea?" (N 2,046). 



Pwcei 



Absolutely necessary. 

Much better off 

Might be a good idea. 
Don't know 



The patient's perception of the degree c 
necessity expressed by the physician indicates the 
in close to 80 percent, of the admissions the docto 
felt a sense of absolute necessity. In only 5 pc 
cent of the instances was (he doctor perceived t 
feel that hospitalkation might simply be a goo 
idea, This percentage of B is the area of absolut 
discretion, and the percentage of 14 expresses pai 
tinl discretion, a combination of 19 percent (2 pei 
cent did not know) . 

Another question asked of the patient 
dealt with the doctor's sense of urgency as lo hoi 
soon the patient should be sent to the hospitn 
"and how urgent did the doctor say it was? Thn 
is, did he want you to go into the hospital rigli 
away, or did he say you could put it o(T for a fc\ 
weeks or months, or did ho just say yon ought t 
go into the hospital eventually?" (N 2,040) : 



[Right away 

Few weeks or months. 

Eventually 

Don't know 



Pcrccn 

7 
1 



It is evident that for 21 percent of th 
patients the doctor felt that hospilalization coiil* 
wait although it should take place eventually. 

The patienls were asked "How did yoi 
yourself feel about being sent to the hospital? 
(N=l,058, excluding unconscious or "too sick ti 
care" (4 percent) patients). 



Glad 

Willing 

Somewhat against-. 
Definitely opposed. 
Don't know 



5' 



Ninety-three percent of the patients say the; 
complied with the doctor's recommendation 



gladly or willingly, 4 percent were somewhat re- 
sistant and went anyway, and only S percent were 
definitely opposed but still went. 

To get some idea about the relative impor- 
tance of cost of hospital and physicians' services 
foi- patients when the doctor said that they should 
bo sent to the hospital they were asked: "How 
much did you worry about the cost of the hospital 
(or doctor) at the time?" (N=l,989) t 



Great deal _. 

A little 

Not at all-- 
Don't know 



Percent 

Hospital Doctor 

12 8 

17 16 

70 75 

1 1 



A minority worried about costs and the pro- 
portions were roughly the same for both hospital 
and physicians 1 costs. 

How did the patients themselves perceive 
their need for hospitalization ? Patients who were 
sent into the hospital for an operation were asked : 
"Was there any doubt in your mind that you 
should have this operation, or did it seem to you 
to be absolutely necessary ?" N = 920) : 

Percent 
Some doubt ---------------------------- B 

Absolutely necessary -------------------- 94 

Don't know --------- ------ ------------- 1 

It would seem that the physician meets 
little resistance in recommending operations with 
only 5 percent doubting, but entering the hospital 
anyway. In this connection, however, it must be 
recalled that this figure excludes patients who 
resisted and did not enter the hospital at all. The 
94 percent who felt the operation was "absolutely 
necessary" were asked why they thought so. 



Percent 

To save life ---------------------------- 3 

Prevent more serious trouble ------------- 16 

Find out what is wrong ------------------ 3 

Relieve, correct condition ---------------- 64 

Doctor said so __________________________ 13 

Miscellaneous -------------------------- 

Don't know --------- . ------------------- 1 

It is of interest to learn that although not 

specifically asked, only 3 percent of those who 

"hought the operation was necessary volunteered 

he opinion that their lives were being saved, and 



that 80 percent felt that the operation would pre- 
vent more serious trouble in the future or relieve 
or correct the condition. Sixty-four percent be- 
lieved that the operation was to relieve or correct 
the condition. We believe that it is of significance 
to learn that 80 percent of those who were ad- 
mitted for surgery felt it was "absolutely neces- 
sary" to have the operation even though the oper- 
ation was not immediately life-saving. It is still 
within living memory when operations were re- 
garded largely as a life-saving procedure. 

The patients who said they were admitted 
for operations were asked : "Was this the kind of 
operation -which might have been done in a doc- 
tor's office or clinic, or was it absolutely necessary 
that they do itin the hospital?" (N"=92Q) : 

Percent 

Might have been in office or clinic 6 

Hospital absolutely necessary 91 

Don't know . 3 

How about treatment without operation, 
could the patient have been treated outside the 
hospital? (N=618): 



Could have been treated outside. 
Hospital absolutely necessary... 
Don't know 



Percent 

8 

86 

6 



Finally, the patients who believed they were 
hospitalized for tests or X-rays were asked if they 
felt such tests and X-rays could have been done 
outside the hospital ? (N-487) : 

Percent 

Could have been done outside 7 

Hospital absolutely necessary 84 

Don't know $ 

This aspect of hospitalization needs more 
detailed examination by comparison with the 
physicians' responses. It also raises questions, of 
course, of the functions of the modern hospital. 



Observations and Implications 

What can be made of these data regarding 
hospital use today and regarding the allegations 
of an appreciable amount of unnecessary use? It 
is difficult to determine how much use may be un- 



necessary without any hard criteria criteria 
which -would still have to be quite arbitrary at 
best. It seems reasonable to assume in. several 
places in this paper that there may be room to cut 
back hospital admissions without presumably 
seriously jeopardizing the health of the patient 
Since we do not know how to measure the impact 
of hospitalization on the health of the patient, we 
then have to rely on a combination of professional 
judgments, desires, and perceived needs, assuming 
conscientiousness and good faith, and on the judg- 
ments, desires, and perceived needs of the patient, 
the ultimate criteria in any case. It is apparent 
that according to patients' reports there was a gray 
area of 10 to 20 percent, depending on the circum- 
stances inquired into, where decisions could have 
gone either way, i.e. in-hospital or out- of -hospital 
treatment. Presumably, if there were some way 
to screen out this gray area of admissions, it could 
not be proven that the public would be any worse 
off because of lack of hard criteria, but money 
would be saved. It depends to what extent we 
wish to have a safety factor. The questions must 
then be asked, what administrative machinery 
would be necessary to screen out this gray area, and 
how would it affect basic professional prerogatives 
and patients' perceptions of need and convenience. 

If we accepted the hard core expression of 
opinion of how patients perceived the doctors' 
sense of necessity, we could eliminate about 20 
percent of the admissions, since in about 80 percent 
of the admissions the doctor felt the admission 
was "absolutely necessary." Perhaps this judg- 
ment can be questioned, too, because we might 
establish an admission policy whereby only acute, 
emergency conditions would be admitted. In this 
study such conditions represented one-third of the 
admissions, adding obstetrics 45 percent of the 
admissions. We should, however, examine more 
closely the 20 percent of the admissions which from 
the patient's report of the doctor's judgment were 
not "absolutely necessary." 

An overall and final observation is that 
neither doctors nor their patients are really push- 
ing hard at the door of the hospital. "We make 
this observation* because after hospital care was 
indicated, over 20 percent of the patients said that 
their doctors felt that hospitalizafcion could be 
delayed for several weeks, months, or longer. 
Further, one-half of the patients delayed seeing a 
doctor after the recognition of symptoms. If 
either the doctor or the patients were not relatively 



conservative regarding the use of hospitals, the 
pressure on hospitals would be much greater than 
it is now. Then also we made no attempt by sur- 
veying the general population to measure the ex- 
tent to which hospital care was recommended but 
never received. Other studies have shown that 
this group is not small. 

All we have said does not, of course, pre- 
clude setting up new forms of hospital and medical 
organizations. The main public policy decision 
must bo whether present hospital resources are 
used wastefully and whether controls at various 
checkpoints should be established which do not 
now exist. Undoubtedly, the use of hospitals can 
be reduced, whether or not they should be, how- 
ever, is a profound problem of public policy. 

THE CHAIRMAN : 

Paul, would you like to step to the micro- 
phone and let us have your discussion? 

MR. PAUL SHEATSLEY : 

Odin alluded to the fact that we interviewed 
doctors on this survey as well as the patients. The 
doctor interviews, some 2,000 of them, have been 
coded and are now being put on IBM cards. Un- 
fortunately, we do not yet have the results; how- 
ever, George Bugbeo thought there might be some 
interest among this audience in the way in which 
we went about obtaining interviews with doctors, 
the methodology we used and, therefore, I thought 
I might briefly describe that and present a few 
findings. 

The doctors we interviewed were deter- 
mined on the basis of patients' answers to two 
questions: First, who was the doctor who first 
told the patient that he needed hospital care; sec- 
ond, who was the doctor mainly in charge of the 
patient's care while ho was in the hospital 1 ? The 
"recommending doctor" was the one who had re- 
ferred the patient to the hospital and the "at- 
tending physician" was the one who had attended 
thopatientin the hospital. 

We wanted to talk to the recommending 
doctor because presumably he was most familiar 
with the patient's home background and the rea- 
sons for hospitalization. 

We wanted to interview the attending phy- 
sician because ho was mainly responsible for the 
patient's care while hospitalized and presumably 
determined the patient's length of sta-y. 



In two out of three cases the recommending 
doctor and the attending doctor were the same 
individual. If the patient did not know the at- 
tending physician's name, we got a description, if 
possible, and then wrote to the hospital librarian 
with whom we had already established contact. 
Some of these descriptions were vague, such as 
the "intern on duty in the emergency room at a 
particular time of day," or "a short man with red 
hair." 

In the course of the Massachusetts study 
over a 19-month period, \ve interviewed 2,046 pa- 
tients and, as Odin mentioned, we had an 87 per- 
cent completion rate of the 2,350 or so who were 
drawn from the sample. The interviewed patients 
named 2,081 doctors as their recommending or at- 
tending physician. These were the ones we at- 
tempted to interview. These 9,681 doctors named 
were not different individuals since, in many cases, 
the same doctor Attended more than one of the pa- 
tients who fell into our sample. This, of course, 
was due to the clustering of the sample that we 
tiad to employ. In a certain hospital, for example, 
one surgeon might do all the T and A's and we 
might draw as many as five or six of his patients. 
Of the 2,681 doctors named, we completed 
interviews with 2,13T or 80 percent. The 20 per- 
cent we did not complete were for the following 
reasons : 

In 101 cases, or 4 percent, the patient ob- 
jected to our approaching the doctor. We re- 
spected his wishes and never made any contact 
with the physician. 

In 217 cases, or 8 percent, the doctor refused 
or could never find the time to be interviewed. 

In 3 percent of the cases the doctor had 
moved out of the area. 

In 2 percent of the cases the doctor was 
unknown we were simply unable to identify him. 
In 1 percent of the cases the doctor denied 
that lie recommended the hospitalization or that 
lie had been the attending physician. There was 
a discrepancy between the patient and doctor re- 
ports, which we could not reconcile. 

And in another 1 percent of the cases, the 
doctor did not remember the patient or had no ac- 
cess to records and could not answer our questions. 
T think this is a fairly remarkable record. 
"We hear a great deal about how difficult it 
is to interview doctors. I attribute our success in 
completing the interview with four out of five of 
the assigned cases, first, to the auspices which we 



had in Massachusetts. Odin mentioned the co- 
operation of Blue Cross-Blue Shield, the State 
Hospital Association, the State Medical Society, 
and the Slate Dental Society. 

In the course of designing the study and of 
preparing our questionnaires and other materials, 
we worked quite closely with a small liaison com- 
mittee which was set up, a very prestigious liaison 
committee, composed of the current president, the 
past president, and the executive secretary of the 
Massachusetts Hospital Association and of the 
Massachusetts Medical Society. These gentlemen 
were, kept informed of our decisions and our prob- 
lems they offered advice and they had an oppor- 
tunity to look over our materials before they were 
finally approved. The secretary of the Medical 
Society in particular was extremely helpful. 

Two notices were placed in the New Eng- 
land Journal of Medicine with respect to the pur- 
poses of our survey and its auspices. 

At the beginning of the survey, the State 
Medical Society sent letters to each of the district, 
societies requesting that their membership be ad- 
vised of the study. When we were ready to start 
interviewing doctors, the Medical Society sent 
out a mass mailing to all 6,000 physicians on their 
roster, again advising them that we were in the 
field, that one or more of their patients might have 
been interviewed, and that we might, come to inter- 
view them. 

Similarly, at the hospitals, we talked with 
the administrator in each sample hospital and he 
often discussed the study with his medical staff 
and encouraged them to offer us their cooperation. 

Finally, before we attempted to interview 
the doctor, there was a letter from the National 
Opinion Research Center on our letterhead which 
enclosed the Medical Society letter, advising the 
doctor of the name or names of patients in our 
sample and announcing that an interviewer would 
soon lie calling to ask him about these cases. 

In addition to these auspices, I think our 
care and skill in conducting (he interviews were 
chiefly responsible for the success we had. 

For one thing, we were careful to get signed 
permission forms from the patients interviewed. 
We found, in a pretest, that approximately 10 per- 
cent of the patients would not sign, while 9 out of 
10 signed without any objections. We asked those 
unwilling : "Have you any objection to our talking 
with the doctor providing it is O.K. with him?" 



Only 4 percent indicated they would, so we re- 
spected their wishes. 

Wo concealed nothing from the doctors. 
We (old them how Ihe patients' names had fallen 
into our sample; told them all about the back- 
ground of the study, its purposes and methods, 
and answered all their questions. This too, T 
think, was helpful in obtaining their cooperation. 

Our interviewers were alert, intelligent, re- 
sourceful women who had been extensively trained 
for this study. They were highly motivated and, 
above all, persistent. We gave the doctor all the 
time ho needed. If the doctor was unable to give 
us an immediate appointment, we called every few 
weeks or wrote him a second letter, and we per- 
sistently followed up all refusals. We wrote per- 
sonal letters to the refusers, answering their par- 
ticular objections, and in a number of cases, we 
persuaded them by means of long distance tele- 
phone calls, I think all of this impressed the 
physicians with the importance of the survey and 
contributed to the results. 

Either Odin or I will be happy to answer 
any further questions about the methodology of 
the survey. 



DISCUSSION 

MR. RAY PI. ELLINQ (Cornell Univer- 
sity, New York) : 

This time study is very important to us, I 
wonder whether one doesn't learn a great deal more 
about users of hospitals by studying both users 
and non-users and whether it would not be better 
as an approach in (he future to start with cohorts 
of population, studying both the people who go 
in and who do not, and get attitudes and the like. 

DR. ANDERSON: 

It's the old story of how much do you bite 
off at once. We considered this and then our cir- 
cumstances changed. We felt that perhaps our 
financial circumstances would change and, as a 
result, we limited the study to the hospitalized 
population. We figured if we could study them 
in great detail, that we would know a great deal 
more than we did before. 

Of course, I would love to study the pop- 
ulation which was not hospitalized but which was 
recommended for hospitalization. Maybe you can 
do that at Cornell. 



MR. ROY PENCI-IANSKY (Harvard 
University) : 

I would like to say that I have some reser- 
vations with respect to opinion samples in this 
typo of area. 

For example, if in evaluating your data you 
consider thai one-third of your people had symp- 
toms over a year old before they saw a doctor 
this means that many of these people are remem- 
bering back, their recall is over a period of a year- 
and-a-half. Additionally, they had intervening 
experiences of doctors' visits and hospitalization. 

I believe you also asked the doctors how 
important the hospitalization was, after they had 
already made a decision to hospitalize these people. 
Are you really going to assume that they are going 
to say it was not important and not necessary, 
especially after they put them into the hospital? 

Therefore, I personally do not give much 
credence to this type of study, but maybe you can 
explain to me how you evaluate these things, and 
possibly I may be able to see use for the data. 

ME. SHEATSLEY: 

I think we can place considerable trust in 
these reports, more than perhaps might seem evi- 
dent. Remember, these h capitalizations were 
drawn from discharge records during the pre- 
ceding calendar month and in most cases (he in- 
terview was completed within a month or at least 
two months after the patient was discharged. 
Consequently, the hospitalization and the things 
that led up to it were fairly fresh in their minds. 

In one long-term illness case, the first signs 
of illness appeared in 189i. We obviously were 
not interested in a detailed medical history of the 
person's condition throughout all those years. In 
the case of these long-term illnesses, we establish- 
ed what wo called a starting date for the present 
episode which, in most cases, was the date of onset 
of the most recent trouble which resulted in the 
particular hospitalization we were concerned with. 
Or, if there was no onset of recent trouble, as in 
the case of a long-standing hernia or something 
of that kind, the starting date was the date the 
patient "decided to do something about it." In 
such long-term cases, we skipped over very super- 
ficially the earlier history. In effect, about all we 
did was count the number of hospitali nations that 
intervened before this one, Our main concern wa, c 
the events which led to this current hospitalization 
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Iii two out of three cases the recommending 
doctor and the attending doctor were the same 
individual. If the patient did not know the at- 
tending physician's name, we got a description, if 
possible, nnd then wrote to the hospital librarian 
with whom we had already established contact. 
Rome of these descriptions were vague, such as 
the "intern on duty in the emergency room at a 
particular time of clay," or "a short man with red 
hair." 

In the course of the Massachusetts stncly 
over a 12-month period, we interviewed 2,046 pa- 
tients and, as Odin mentioned, we had an 87 per- 
cent completion rate of the 2,350 or so who were 
drawn from the sample. The interviewed patients 
named 2,681 doctors as their recommending or at- 
tending physician. These were the ones we at- 
tempted to interview. These 2,681 doctors named 
were not different individuals since, in many cases, 
the same doctor attended more than one of the pa- 
tients who fell into our sample. This, of course, 
was due to the clustering of the sample that we 
had to employ. In a certain hospital, for example, 
one surgeon might do all the T and A's and we 
might draw as many as five or six of his patients. 
Of the 2,681 doctors named, we completed 
interviews with 2,137 or 80 percent. The 20 per- 
cent wo did not complete were for the following 
reasons: 

In 101 cases, or 4 percent, the patient ob- 
jected to our approaching the doctor. We re- 
spected his wishes and never made any contact 
with the physician. 

In 217 cases, or 8 percent, the doctor refused 
or could never find the time to be interviewed. 

In 3 percent of the cases the doctor had 
moved out of the area. 

In 2 percent of the cases the doctor was 
unknown we were simply unable to identify him. 
In 1 percent of the cases the doctor denied 
that he recommended the hospitalization or that 
he had been the attending physician. There was 
a discrepancy between the patient and doctor re- 
ports, which we could not reconcile. 

And in another 1 percent of the cases, the 
doctor did not remember the patient or had no ac- 
cess to records and could not answer our questions, 
I think this is a fairly remarkable record. 
We hear a great deal about how difficult it 
is to interview doctors. I attribute our success in 
completing the interview with four out of five of 
the assigned cases* first, to the auspices which we 



had in Massachusetts. Odin mentioned the co- 
operation of Blue Cross-Blue Shield, the State 
Hospital Association, the State Medical Society, 
and the State Dental Society. 

In the course of designing the study and of 
preparing our questionnaires and other materials, 
we worked quite closely with a small liaison com- 
mittee which was set up, a very prestigious liaison 
committee, composed of the current president, the 
past president, and the executive secretary of the 
Massachusetts Hospital Association and of the 
Massachusetts Medical Society. These gentlemen 
were kept informed of our decisions and our prob- 
lems they offered advice and they had an oppor- 
tunity to look over our materials before they were 
finally approved. The secretary of the Medical 
Society in particular was extremely helpful. 

Two notices were placed in the New Eng- 
land Journal of Medicine with respect, to the pur- 
poses of our survey and its auspices. 

At the beginning of the survey, the State 
Medical Society sent letters to each of the district 
societies requesting that their membership be ad- 
vised of the study. When we were ready to start 
interviewing doctors, the Medical Society sent 
out a mass mailing to all 0,000 physicians on their 
roster, again advising them that we were in the 
field, that one or more of their patients might have 
been interviewed, and that we might come to inter- 
view them. 

Similarly, at the hospitals, we talked with 
the administrator in each sample hospital and he 
often discussed the study with his medical staff 
and encouraged them to offer us their cooperation. 
Finally, before we attempted to interview 
the doctor, there was a letter from the National 
Opinion Research Center on our letterhead which 
enclosed the Medical Society letter, advising the 
doctor of the name or names of patients in our 
sample and announcing that an interviewer would 
soon be calling to ask him about these cases. 

In addition to these auspices, I think our 
care and skill in conducting the interviews were 
chiefly responsible for the success we had. 

For one thing, we were careful to get signed 
permission forms from the patients interviewed. 
We found, in a pretest, that approximately 10 per- 
cent of the patients would not sign, while 9 out of 
10 signed without any objections. We asked those 
unwilling : "Have you any objection to our talking 
with the doctor providing it is O.K. with him?" 



Only 4 percent indicated they would, so wo re- 
spect ed their wishes. 

We concealed nothing from the doctors. 
We told them how (lie patients' names had fallen 
into our sample; told them all about the back- 
ground of the study, its purposes and methods, 
and answered all their questions. This too, I 
think, was helpful in obtaining their cooperation. 

Our interviewers were alert, intelligent, re- 
sourceful women who had been extensively trained 
for this study. They were highly motivated and, 
above all, persistent. We gave the doctor all the 
time ho needed. If the doctor was unable to give 
us an immediate appointment, wo called every few 
weeks or wrote him a second letter, and we per- 
sistently followed up all refusals. Wo wrote per- 
sonal letters to the refusers, answering their par- 
ticular objections, and in a number of cases, we 
persuaded them by means of long distance tele- 
phone calls. I think all of this impressed the 
physicians with the importance of the survey and 
contributed to the results. 

Either Odin or I will be happy to answer 
any further questions about the methodology of 
the survey. 



DISCUSSION 

MR. BAY H. ELLING (Cornell Univer- 
sity, New York) : 

This time study is very important to us. I 
wonder whether one doesn't learu a great deal more 
about, users of hospitals by studying both users 
and non-users and whether it would not be better 
as an approach in the future to start with cohorts 
of population, studying both the people who go 
in and who do not, and get attitudes and the like. 

DR. ANDERSON: 

It's the old story of how much do you bite 
off at once. We considered this and then our cir- 
cumstances changed. Wo felt that perhaps our 
financial circumstances would change and, as a 
result, we limited the study to the hospitalized 
population. We figured if we could study them 
in great detail, that we would know a great deal 
more than we did before. 

Of course, I would love to study the pop- 
ulation which was not hospitalized but which was 
recommended for hospitalization. Maybe you can 
do that at Cornell. 



MR. ROY PENCHAKSKY (Harvard 
University) : 

I would like to say that I have some reser- 
vations with respect to opinion samples in this 
type of area. 

For example, if in evaluating your data you 
consider that one-third of your people had symp- 
toms over a year old before they saw a- doctor 
this means that many of these people are remem- 
bering back, their recall is over a period of a year- 
and-a-half. Additionally, they had intervening 
experiences of doctors' visits and hospitalization. 

I believe you also asked tho doctors how 
important the hospitalization was, after they had 
already made a decision to hospitalize these people. 
Are you really going to assume that they arc going 
to say it was not important and not necessary, 
especially after they put them into the hospital? 

Therefore, I personally do not give much 
credence to this type of study, but maybe you can 
explain to me how you evaluate these things, and 
possibly I may be able to see use for the data. 

ME. SHEATSLEY; 

I think wo can place considerable trust in 
these reports, more than perhaps might seem evi- 
dent. Remember, these hospitolizations were 
drawn from discharge records during the pre- 
ceding calendar month and in most cases the in- 
terview was completed within a month or at least 
two months after the patient was discharged. 
Consequently, tho hospitalise* ion and tho filings 
that led up to it were fairly fresh in their minds. 

In one long-term illness case, the first signs 
of illness appeared in 18!H, We obviously were 
not interested in a detailed medical history of the, 
person's condition throughout all those years. Tn 
the case of these long-term illnesses, we establish- 
ed what we called a starting date for the present 
episode which, in most cases, was tho date of onset 
of the most recent trouble which resulted in the, 
particnlarhospilalization wo were concerned with. 
Or, if there was no onset of recent trouble, as in 
the case of a long-standing hernia or something 
of that land, the starting date was the elate the 
patient "decided to do something about it," In 
such long-term cases, we skipped over very super- 
ficially the earlier history. Tn effect, about all we 
did was count the number of hospital! 2 at ions that 
intervened before this one. Our main concern was 
the events which led to this current hospital) zaliou 



712-881 O 03- 



41 



which, as I say, was a much more recent thing and 
therefore quite fresh in the person's mind. 

Further, of course, the patient's report is 
only one of the kinds of data that we are using 
in our analysis. We also have the interviews with 
the doctors, who referred to their records while 
they were answering the questions, and we do 
have the hospital records too, of course. 

ME. T. WOOLSEY (National Health 
Survey Division, Public Health Service, "Wash- 
ington, D.C.) 

I would like to hear again a figure that I 
thought I heard near the beginning of Dr. Ander- 
son's paper and, if I heard it correctly, I am very 
much interested in it and I think there might be 
some discussion on it. 

The figure I thought I heard was that 10 
percent of the patients had been admitted as in- 
patients and discharged on the same day without 
spending a night in the hospital. I would like to 
know whether this is common and, if so, what is 
the relationship in the factor of having health in- 
surance, and further, isn't this of some concern 
to people who are talking and discussing problems 
relative to the use of hospital care? 

DR. ANDERSON: You have heard cor- 
rectly. 

ME. WOOLSEY: 

How many of them were deaths? That 
perhaps would be a limiting factor. I might say 
that we have been looking for a figure on this par- 
ticular thing and that we did get one from the in- 
surance experience. However, it was a good deal 
smaller than that. 

DE. ANDEBSON: 

You were confused by the 10 percent figure. 
It was 10 percent one day or less, but the same day 
2 percent 

ME. WOOLSEY: 

You do not have an analysis by diagnosis 
or type of treatment? However, wasn't there, you 
think, some tonsillectomies in there, as well as 
dental care ? 

MR. SHEATSLEY: 
Yes. 
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MR. WOOLSEY: 

However, the 2 percent, is much closer to the 
figure I heard about. 

DR. MARK S. BLUMBERG (Sianford 
Research Institute, California) : 

In connection with one of the points just 
made, I would like to say that it is an interesting 
thing in hospital accounting of patients these days, 
that the so-called in-and-out oases are counted as 
one patient clay. Also, if you come in one day and 
go home the next day, this is also counted as one 
patient day. Therefore, in services with a lot of 
tonsillectomies or fracture settings or other things 
where they do not spend the night, you can get 
into material errors. 

I would also like to make one other com- 
ment about your general population, in the fart 
that you omitted obstetrics. Possibly you didn't 
think there would be as many vagaries in that. 

I would like to point out that there are quite 
a lot of false labors coming in and maybe this may 
be something quite good to study because almost 
all of them are delivered in hospitals. On the 
other hand, you could judge a doctor's quality of 
performance by how many f&lse labors lie admit- 
ted. We found upwards of, in some cases, 10 per- 
cent false labors in communities where you have 
a lot of primipara a woman having her first 
baby. This was not in a rural area it vnis in an 
urbanized area. I think it is a big waste of time. 

Further, you can also get confused because 
a lot of false labors come in and somebody is em- 
barrassed and really induces them and so they go 
home with babies. However, they were really 
false labors when they first came in. 

DR. ANDERSON: 

I would agree with you on that. Again, 
when we thought about this project, we likewise 
had to think about what sort of things we wanted 
answered. Of course, our immediate question 
was are hospitals used unnecessarily? Since by 
definition (even with the 10 percent you talk 
about) obstetrical cases should be in the hospital, 
we were greatly relieved to be able to eliminate 
20 percent of admissions because we still had 80 
percent left to study. This is the rationale we 
used toward excluding obstetrical cases. There- 
fore, I wish that somebody else would take over 



from here and go into the general population 
relating to obstetrics, etc. 

THE CHAIRMAN: 

In simple words, financial expediency I ex- 
pect limited it. 

MR. WECKWERTH (University of Min- 
nesota) : 

For your information, during this past 
summer, wo did a survey of the Twin City hospi- 
tals, in metropolitan Minneapolis and St. Paul 
suburban areas, in which we got information from 
every hospital in the Twin Cities. We wont into 
the records and found the kind of information 
you have. 

In connection with every hospital, we have 
a distribution as to length of stay based upon the 
day in which they came in. We found out the 
average length of stay and admission on Monday 
was no greater than on Tuesday. We also have 
statistics with respect to the day they were admit- 
ted, the day they were discharged, and also in- 
formation on all of the things you checked with 
respect to length of stay the ins and outs, the 
one days. 

We also found out that certain hospitals 
count to the nearest third, to the nearest half, or 
the nearest two-thirds of a day, depending on the 
length of stay, Therefore, we tried to clear up 
this discrete problem of single days of stay at the 
low end of the distribution. We have the total 
bill the patient was charged and we also have the 
distribution. At the present time, we are fitting 
together models to try to predict distribution, for 
all Twin City admissions to the population of the 
metropolitan area, determining the relationship 
for age and probability of admission. This is 
linear and not exponential, The rate of increase 
is 26 percent per decade of age. We have this 
whole mass of data which we will not publish. We 
have no money to do this on our own. We have 
228,000 admissions. 

DR. HALDEMAN; 

Dr. Anderson, a year ago, at our Conference, 
there was a good deal of discussion on whether 
proper utilization rate could be determined or de- 
veloped. I think you took the attitude that there 
was no proper utilization rate, Some individuals 
took exception to this and said that objective cri- 



teria could be developed on a scientific basis which 
could be used as a guide to physicians in relation 
to hospital use. I wonder if you would get into 
the record some of that discussion. 

DR. ANDERSON: 

Since making the remark, I have changed 
my mind. (Laughter.) I have changed it to this 
extent that if I were a dictator of a health serv- 
ices system and needed to allocate resources to go 
to the moon instead of spending it on hospitals, I 
would cut back all hospitalization to emergencies ; 
I would include normal maternities, so I would 
cut it back TO percent and so 30 percent is neces- 
sary. 

DR. HALDEMAN; 

Would you go on and discuss the factors 
influencing what you consider proper use? 

DR. ANDERSON: 

Well, I Avas being facetious, of course, 
However, if wo get our doctor data, the results will 
probably agree with the patient perception be- 
cause the patient is very likely to reflect what the 
doctor said or expressed. 

In today's prevailing methods of medical 
practice it would appear that hospitalization is 
absolutely necessary in 80 percent of the cases, 
The patients feel it is absolutely necessary and, 
therefore, I cannot deny it. This is how they feel 
and this is what they arc willing to pay for. There- 
fore, I will work on the other 20 percent, to find 
out more about that, 

My personal feeling is neither here nor 
there. Do you want a tight or loose system, given 
reasonably good quality, etc, ? Do you want to wait 
S months or don't you want to wait more than a 
week ? Figure out what kind of system, what kind 
of check points you need, etc. 

Of course, if there is enough money, I per- 
sonally would prefer a loose system, However, if 
you want to go to the moon instead of going to 
the hospital, then we may have to cut back 20 
percent, 

DR. PAYNE; 

I am hero to function as a physician and 
there is one misapprehension thnt ouglit to be 
brought to your attention about false labors be- 
cause, after all, it is in just this sort of misunder- 



standing that people who deal with statistics alone 
do make errors in dealing with medical facts. 

False laboi 1 , if it is a limitation at all, is a 
patient limitation, not a physician limitation. The 
patient honestly comes into the hospital in labor 
and then, for reasons nobody understands, stops 
having contractions. The logical thing is for them 
to go home, which they do. They may occasion- 
ally have several episodes of false labor before 
they actually go into labor that terminates in a 
live birth. 

This is, as we choose to call it, a patient 
limitation. This has nothing to do with the skill 
of the physician in choosing when the patient goes 
into the hospital. There are times when he will 
actually delay a patient's admission to the hospital 
unwisely so that delivery occurs in an ambulance, 
in a taxi, and, as a result, these things do get into 
the newspapers. Therefore, the inclination of the 
patient is to demand admission when in labor and 
the physician complies because the patient is in 
labor. It is only later that this ceases. 

DR. AKTHUR C. HOLLISTER (Depart- 
ment of Public Health, California) : 

The previews of this paper published in our 
little bound book from the Conference last year 
mentioned considerable emphasis was going to be 
placed on nonmedical factors relating lo this and 
perhaps I missed the discussion and I apologize 
and can be ruled out of order. However, I think 
you were going to look with particular emphasis on 
such things ns home environment, patient's family 
and family pressures for hospitalization, and avail- 
ability of insurance. T believe you spoke on one 
but not on the other two. Therefore, are there any 
other comments yon desire to make about the points 
we have not cleared as yet? 

DE. ANDERSON: 

I don't have information on them yet. The 
factors you mentioned will not be ignored. It is a 
matter of budget and finances. 

BK. I. WEISSMAN (Hospital Council of 
Western Pennsylvania, Pittsburgh) : 

I think we have to be more specific regard- 
ing some of the admission statistics. For example, 
in Michigan the average slay for a coronary oc- 
clusion is 3 weeks, and elsewhere it is 7 weeks. 
Also it is indicated that the average maternity 
stay in one place may be 21 days and in another 



place 7 days. Therefore, I think that in the long 
run the concept we need is a medical one and you 
can get some consensus about that within some 
range. 

DR. ANDERSON: 

You can get consensus but I don't know 
what consensus means. This is what wo have to 
rely on. 

DR.R.E.TRUSSELL: 

I would like to support the views of those 
who think maternity patients should be included 
in some of these studies. Usually maternity serv- 
ices are poorly covered by health insurance bo- 
cause of the argument that even people with low 
incomes can still budget enough money to pay the 
rest of the bill. Thus the pressure is on the young 
person financially to get money together ahead of 
time, There are also other pressures which con- 
tribute to this poor coverage. 

In our New York City system of municipal 
hospitals, we have about 35 or 36 thousand babies 
a year. One of our largest hospitals lias between 
6 and 7 thousand deliveries a year. This is under 
the direction of Professor Hellman, who believes 
that it is perfectly safe to send many women home 
the first day they deliver. He and Dr. Kohl have 
published a paper based on measurements of a 
variety of factors for a large number of mothers 
and have come to a conclusion that (hey regard 
early discharge as safe procedure. Statistically 
it appears quite plausible and I am not arbitrarily 
condemning it. 

On the other hand, the health department 
has sent public health nurses out to visit some of 
these people and they have found problems such 
as unwed mothers being sent home with babies 
and not receiving any instruction. Moreover, 
they find people who have developed a variety of 
complications, 

I mention this primarily to emphasize the 
fact that utilization studies are useful in estab- 
lishing a base from which to get into an epi- 
demiological approach to morbidity following 
certain events within the hospital. 

I think maternity is a field that perhaps 
should not be so easily excluded from study. Per- 
haps it can be tightened down between the two 
extremes of too long a stay and obviously too short 
with too little supervision for some patients. 
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THE CHAIRMAN: 

I thank yon for that comment, Ray. I 
think the last question was not intentionally not 
answered or not recognized properly. J think 
we will see, as various studies are reported today, 
that there is plenty of room for expanding method 
and investigation. This is a study of patients' 
opinions and physician opinion without measuring 
them against any standards. It has all those limi- 



tations. It nonetheless yields information about 
what patients thought happened and physician 
opinion as to why they proceeded us they did. 
However, this does not necessarily mean it estab- 
lishes a standard. We would hope that it will be 
descriptive and raise questions that point toward 
the sort of research that Peterson and Barsamian 
and Dr. Payne tind Dr. McNerney will be 
discussing. 



TUESDAY AFTERNOON SESSION 
January 22, 1963 



The Conference was reconvened at 
1 :40 p.m.jMr Bugbee presiding. 

THE CHAIRMAN: 

Talks by Walter McNeniey and his as- 
sociate, Dr. Payne, will open this afternoon's 
session. 

Walter McNerney is President, Blue Cross 
Association, a former member of the faculty of 
Program and Hospital Administration at Pitts- 
burgh, and he organized the program at the Uni- 
versity of Michigan. He came to his present 
assignment about a year ago, after a very ex- 
tensive and rigorous study in the State of Michi- 
gan, touched off by action at the State level. This 
study, supported by the Kellogg Foundation, re- 
sulted from the concern, expressed over the 
increasing use and price of hospital and medical 



care as reflected in the dollar increase in Blue 
Cross and Blue Shield premiums in Michigan. 

Dr. Beverly Payne was very much involved 
in that study and, as I have already said, Dr. 
Payne is an internist, a member of the faculty at 
the University of Michigan. He will discuss Mr. 
McNerney's presentation. 

On the platform we also have Don Rledel, a 
sociologist, who was a member of the study team 
and is now Director of Research and Planning, 
Blue Cross Association, and Tom Fitzpatrick, also 
a member of the study team, who is presently a 
member of the faculty of the graduate program in 
hospital administration at Michigan. 

I assume, Walter, you will call on these 
people as indicated or they will join in the discus- 
sion, as you wish. 



MICHIGAN STUDIES IN" HOSPITAL USE 



MR. WALTER J. McNERNEY: 

The major burden will be carried by Bev 
Payne. I will make a few introductory remarks. 
Tom Fitzpatrick and Don Riedel will join in 
answering questions. 



Hospital and Medical Economics 

I should like to start by discussing very 
briefly some of the studies within Hospital and 
Medical Economics that deal with hospital use, 
leading up to the study of Character and Effective- 
ness which Bev will discuss in some detail. The 
study of Character and Effectiveness is only one 
of several that deal with hospital use. 



POPULATION SURVEY. An area 
probability sample was drawn of the Michigan 
population and a household survey of the sample 
undertaken involving 1,031 families and 3,516 in- 
dividuals. This work was done by the Survey 
Research Center. 

The interviewers asked such questions as 
what use do you make of health facilities; and 
what are the out-of-pocket costs involved? Also, 
they probed regarding unmet need and insurance 
status. Considerable personal data were collected. 

The usual impact of age and sex on fre- 
quency of hospitalization was found. On a family 
basis, the younger families had higher use rates. 
On an individual basis, the aged had higher use 
rates. 
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A multivariate analysis of admission rates 
confirmed the effects of age and sex, plus prepay- 
ment and insurance on admission rates. For ex- 
ample, persons with nigh degrees of coverage, i.e., 
that paid 70 percent of the hospital bill or more, 
had almost twice the admission rate of those with- 
out, coverage, after allowing for effects of age, sex, 
income, family size, attitude toward seeking early 
care, education of the families, and the region 
whore the family head grew up. With adjust- 
ments for these factors, it was also shown that 
the admission rates decreased as income increased 
up to the highest income group, which was above 
tho average. 

The difference between those with high 
degree of coverage and thft noncovered, in regard 
t,o frequency of hospi taxation, was attributable 
largely to surgery. 

This study also showed a positive associa- 
tion between patient days per thousand population 
and the availability of facilities. 

One section of the Population Survey dealt 
with self-perceived need and also with treatment 
prescribed by a doctor that had or had not been 
followed. There was some evidence that those 
with insurance or prepayment had fewer self- 
perceived unmet medical needs than those with- 
out. Those without prepayment or insurance also 
scored higher on a specially constructed unmet 
needs index constructed on the basis of reported 
symptoms or difficulties. 

There was evidence that the seriousness of 
tho reported symptoms, according to the needs 
index, had little bearing on individual plans to get 
treatment. 

Tho principal factors causing delay seemed 
to bo : "too busy" or "can't afford it" for those who 
intended to get some care, and "money" and "dis- 
agree with doctor's advice" for those that did not 
plan to get it. 

The Population Survey introduced for the 
first time the application of multivariant analysis 
to hospital and medical variables on a large scale. 
It was unique in (lie development of the unmet 
needs index, and, I think, in the extent to which 
information was validated through resort to basic 
records in hospitals and prepayment and insur- 
ance companies. 

HOSPITALS AND ALLIED INSTITU- 
TIONS .-This study also dealt with the relation- 
ship between utilization and availability of fa- 
cilities. It showed a strong association between 



the two. Patient days per thousand population 
were examined in relationship to the availability 
of hospital beds, with controls on population per 
physician, average size hospital, effective buying 
power index, percentage of the population 65 or 
over, percentage of the population urban, and the 
cost per patient day. 

Tho largest single cause of variation in 
patient days, some 71 percent, was attributable 
to the number of beds available. The average size 
of the hospital was next, followed by percentage 
of the population urban and cost per patient day. 

A second multivariant analysis omitted 
cost per patient day as an independent variable 
and supported the first analysis. 

PREPAYMENT AND INSURANCE, 
Although the studies under this general titl& do 
not bear directly on hospital use ? in the sense that 
we have been talking about it, I might at least make 
reference to a few of them. An attempt was made 
to measure the comparative loss ratios of groups 
over 100 members in size leaving Blue Cross -and 
going to commercial insurance over a 4-year 
period and those over 100 in size going from com- 
mercial insurance to Blue Cross. The majority of 
the groups had 3 years' experience before they 
moved. 

Groups leaving Blue Cross had an average 
loss ratio that was significantly lower than that 
of the groups joining Blue Cross. The trend was 
toward higher ratios joining Blue Cross. Group 
representatives leaving Blue Cross who were inter- 
viewed cited, in a large number of instances, the 
element of rate in making a decision. Michigan 
Blue Cross follows a relatively pure form of com- 
munity rating. The commercial companies in- 
volved in the study experience rated their ac- 
counts, The results of the study showed that the 
experience-rating techniques were skimming the 
good risks from Blue Cross leaving Blue Cross 
with a disproportionate number of high risks. 

Under the general topic of "Prepayment 
and Insurance," tho effect of the group charac- 
teristics on claims experience was studied under 
Blue Cross. The groups were divided for analy- 
sis purposes into size categories, occupational cate- 
gories (such as manufacturing, commercial, 
utilities, government, professional, farm, and hos- 
pitals) and geographical categories. Within and 
among categories the range in loss ratios was 
extensive. For example, by occupation alone, the 
loss ratio for government atone extreme was about 



90 ; for hospital personnel at the other extreme it 
was about 128. By geographical region over the 
State, the extremes in loss ratios were from 88 to 
120. 

Such a gross analysis is good only for 
screening purposes. It is highly desirable to go 
into much more depth by adding such variables 
as per capita income in the area, availability of 
facilities, employer contribution to the costs of 
the rare, urban-rural mix, effectiveness of hospital 
caro and morale factors. 

The relationship between benefit levels and 
hospital utilization was studied. Two pairs of 
groups were selected with similar occupations, in 
similar geographical locations. They were of suf- 
ficient size to control the effects of age and sex. 
Types of benefits differed significantly within 
each pair. 

In groups A and B, A had highly indemni- 
fied benefits through commercial insurance and 
group B had a fairly comprehensive contract 
through Blue Gross and Blue Shield. In group C 
there was an indemnified base ; in group D a Blue 
Cross-Blue Shield base; major medical was super- 
imposed in each case. 

The findings showed that the claim rates 
were lower for both males and females under the 
more limited benefits in each pair of groups. Fur- 
thermore, the greater degree of indemnification 
between the two groups that were indemnified, 
produced a lower average cloim rate. 

Here was an attempt to match groups and 
to get at the question of the impact of benefit level 
on hospital utilization. This method has its dif- 
ficulties. Often one cannot take into account 
enough variables through the matching process. 
Also, satisfactory prototypes are hard to find. It 
would be well, in addition to the above method, to 
get levels of benefits through a population survey, 
put these on a continuum, and analyze them con- 
currently with relevant-variables. 

The effect of layoffs on continuity of cov- 
erage during recession periods was studied. You 
will recall that in late 1957 and early 1958 there 
was a recession. A large company in Michigan 
made it possible for employees, even though laid 
off, to continue health coverage for 12 months at 
group rates and benefits. In fact, for 2 months 
after the layoff premiums were prepaid. Also, 
for 1 month loss of income was prepaid. 

A sample of those laid off in February of 
1958 was selected for study. First, prepayment 
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status before and after layoff was examined. Then 
utilization was plotted in the following ways: for 
the year prior to layoff, from the layoff date to 
date of disposition, for comparable months in! 1957 
to layoff months in 1958, and for the month follow- 
ing layoff compared to the same month the pre- 
vious year. 

A rapid decay in enrollment was found. 
In the first billing 33 percent of the persons in the 
sample did not take advantage of the offering of 
group rates and benefits. Later an additional 24 
percent did not pay their billed rates, bringing the 
total of those who dropped their coverage to 57 
percent, even though in some cases the wife was 
pregnant or medical need was imminent. 

The utilization rates during the layoff pe- 
riod were from 1.5 to 7.9 times those for the same 
people during a comparable period in a previous 
year. In March following layoff, the utilization 
was from 6 to 14 times the utilization in the con- 
trol period a year previous. 

It was interesting to note that those who 
continued coverage were higher users before and 
after the layoff period. There was no noticeable 
difference between family and single subscribers, 
but a special study of spouses revealed that there 
was no increase in their utilization during the 
period studied. The increased use was entirely 
attributable to the subscriber himself. 

This has been a very brief overview only. 
There are included in Hospital and Medical Eco- 
nomics other studies that bear on the issue of hos- 
pital use involving some designs that have not been 
used previously. Many topics beyond hospital use 
are also included. 

In the study of Character and Effective- 
ness of Hospital Vse^ Dr. Payne's topic, during the 
early stages we wrestled with the problem of how 
to measure the validity of hospital use, very con- 
scious of the fact that this would undoubtedly be 
one of the basic and central questions to arise when 
Blue Cross rates were under scrutiny. 

We, as all of you probably have at one time 
or another, looked first at the possibility of meas- 
uring variation in current practices. An analysis 
of variation, however, even when several inde- 
pendent variables are available, leaves unanswered 
whether one extreme or another, or any other 
point, is the point of effective use. The study 
of character of use which we did undertake did 
point the way successfully toward ureas that 



needed further investigation, but it did not pro- 
vide hard answers on how valid the use was. 

We examined the possibility of the case ap- 
proach, i.e., asking knowledgeable physicians to 
look at selected records, and to make professional 
judgments regarding such things as adequacy of 
the history and physical relevancy of the pro- 
cedures, and appropriateness of the length of stay. 
Scales of excellence could have been developed to 
refine the analyses. 

This approach was discarded because it- 
looked to be too subjective. It, involved too many 
opportunities for physicians to rationalize differ- 
ences. In the absence of any specific' criteria or 
reference points, it would have been difficult to 
evaluate the results in retrospect or to have dupli- 
cated the methods over time even within one in- 
stitution. Certainly it made comparisons among 
institutions very difficult. 

There was also the possibility that we might 
use a longitudinal approach in evaluating hospital 
use. Possibly certain results could have been re- 
lated to certain procedures. This, however, prom- 
ised to offer many technical as well as cost prob- 
lems. 

We came ultimately to the idea of flexible 
criteria of effective use being developed by experts 
and applied to a probability sample of records in 
a probability sample of hospitals. Through this 
method, appropriateness of admission, relevance of 
procedures, and understay as well as overstay could 
be measured. Also, some of the following ad- 
vantages could be obtained : 

The method could reflect the best thinking 
that was available at a. given point in time, assum- 
ing that the experts were well -selected. We felt 
it, could be objective because the criteria could 
be developed prior to the evaluation and by dif- 
ferent, people. We also felt that the method could 
bo duplicated consistently within a hospital or 
among hospitals over time. Finally, we felt that 
this approach could give some substance to the 
idea of norms and still leave room enough for in- 
terpretation when provision was made for inter- 
views of the attending physician. 

It was recognized that this would be a time- 
consuming process and that there was a danger of 
the criteria being sanctified or used even when out- 
dated. Both of these hurdles could be overcome, 
however the first through the development of 
successful prototypes and the second through ju- 
dicious administration. 



Dr. Payne will discuss the development of 
the criteria and their application to patient rec- 
ords. We are convinced that this approach is 
practical and that it can be used to great advantage 
by hospitals and other agencies. 

Dr. Payne will not be talking of measures 
of quality, although there will be qualitative as- 
pects to a groat deal of what he says. The criteria 
are not detailed enough to hear directly on quality. 
Ultimately, the techniques Dr. Payne will describe 
should be applied to whole episodes of illness on 
a population survey basis and joined to other stud- 
ies to explain more effectively, for example, why 
loss ratios vary so much among groups. With 
that as a brief reference framework, I should like 
to introduce Dr. Payne. 



Character and Effectiveness of Hospital Use 

DR. BEVERLY PAYNE: 

Thank you very much. I was told that this 
was going to be a very small meeting and that we 
would sit in a very confined area and exchange 
confidences. So, if you will get close in, at least 
figuratively, this is exactly how I intend to talk to 
you about these negotiations that were developed 
in (he Michigan study. I will attempt to explain 
Hie problems as we anticipated them and the prob- 
lems that wo could not anticipate; problems of 
criticism that we hoped to answer before we were 
ever questioned. 

You have been told that we finally decided 
upon developing criteria. Since this had never 
been clone before in a formal way, this was an 
innovation which caught most of the physicians 
with whom I had discussed this quite by surprise. 
Fortunately, physicians behave in a fairly pre- 
dictable manner, at least in their own practices, 
and have their own criteria for behaving as they 
do, Therefore, when you get a consensus among 
them for the care of patients, a reasonable assump- 
tion can be made as to what they do in practice. 
And I will assure you that the results of the study 
convinced us that our assumptions were true. 

Now> our first problem was one of establish- 
ing who was to do this criteria development who 
was competent enough and interested enough, in- 
volved enough, to create criteria for care, for 
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measurements of a-ppropriateness of admission, 
and for length of stay in Michigan hospitals. 

Now, since I live in Ann Arbor and am part 
of the University faculty, my first contacts were 
with my colleagues. I went to the best advice I 
could get, to the heads of the departments at the 
University Medical School and I asked, "To whom 
might I go in the State to form a panel to consider 
the establishment of criteria?" In each instance 
I was given a list of physicians whom I might 
approach. 

The approach was initially made by letter 
indicating to them the nature of the study to be 
done and our desire that they participate. I then 
made personal visits to all of the physicians who 
might be asked to join in this effort and in only 
one instance was my request rejected. 

We ended with panels that represented 
physicians and specialty organizations from both 
medical schools, Wayne State and the University 
of Michigan, and one or more physicians who prac- 
ticed in Michigan, who were considered outstand- 
ing because of their training-, their participation 
in medical educational efforts, and who were recog- 
nized by the physicians in Michigan as a peer 
group. 

Most of these panels consisted of three or 
more physicians. The panel in surgery was prob- 
ably the largest. There were six surgeons each 
of whom was very capable. 

The panels were then asked to meet with us 
in Ann Arbor to establish criteria for selecting 
diagnoses that would have a substantial impact 
upon hospitalization in the State of Michigan in 
1958. The statistical basis for tha choice of these 
diagnoses came through Professional Activity 
Studies and, through them, we were given the 60 
most common diagnoses occurring in Michigan 
hospitals in 1957. From this list we chose 18 diag- 
noses which represented 47 percent of the dis- 
charges from Michigan hospitals in 1958. We 
were fortunate that the diagnoses represented such 
a large percentage of discharges. It not only 
represented care that might reasonably ba expected 
to be rendered by specialists and nonspecialists 
alike but also many phases of medical activity 
surgery, medicine, pediatrics, orthopedics, urol- 
ogy, and gynecology. 

The panels then assembled with the diag- 
noses they were to consider. The surgery panel 
was to consider inguinal hernia, cholecystitis, and 
appendicitis; the medical panel \vns to consider 



diabetes, acute myocardial infarctions, bronchial 
asthma, and pneumonia; the pediatric panel was 
to consider the same medical diagnoses as applied 
to pediatrics plus diarrhea occurring under the age 
of two and prematurity; the gynecologists con- 
sidered the diagnoses of fibromyoma of the uterus 
and what eventually was called the conditions of 
pregnancy. 

We had initially indicated the desire to 
study deliveries, but our panel convinced us that 
our goal was too limited that we really needed to 
consider all of the conditions of pregnancy, includ- 
ing false labor, toxemia of pregnancy, cesarean 
section, as well as full-term deliveries. 

Each panel then, in one evening of intensive 
discussion, created criteria which were then codi- 
fied or listed in a coherent fashion. The criteria 
were then sent to each individual member of the 
panel for correction or additions or deletions and 
then, after we had the final confirmation by the 
panel, we composed the final new criteria. This 
was again mailed to each panelist for a final 
comment. 

Each panel was expected to do four things ; 
First, create a criteria for admission, i.e., 
when should this patient with this condition be 
admitted to the hospital ; what were the indications 
of the appropriateness of the admission to the 
hospital? 

Second, determine the procedures both 
necessary and consistent with the diagnoses, i.e., 
which procedures would logically be produced in 
the hospital for each individual diagnosis? 

Third, determine what complications might 
affect the length of stay in the hospital. 

Fourth, assess the expected length of hospi- 
tal stay. 

Finally, appraise the indications for dis- 
charge. 

One other activity was undertaken by the 
internal medicine panel, but we were unable to 
make use of it. I mention this because I hope that 
in the future it can be used. This was the criteria 
for diagnostic admissions to the hospital when 
is a patient logically expected to be admitted to the 
hospital for diagnostic procedures? The criteria 
for admission obviously differed with each 
diagnosis. 

In most instances, the criteria were quite 
stringent and required the physician admitting the 
patient to the hospital to be intimately familiar 
with conditions of the patient. 
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We had hoped to develop procedures to 
measure proper or appropriate use of laboratory, 
X-ray, and physiotherapy facilities. These we 
wore able to develop only to a certain degree that 
is, it was possible for the panels to tell us what 
procedures were certainly necessary in each diag- 
nosis but not to identify excessive use of these an- 
cillary services. 

We were unable to get a consensus on a top 
limit of procedures to be done in the hospital for 
instance, in diabetes it is quite possible to say that 
the patient who is admitted must have a blood 
count, urinalysis, chest X-ray, and blood sugar. 
But the immediate question is how many blood 
sugars? This was impossible to answer. It was 
also impossible for the panels to determine in ad- 
vance what procedures might be appropriate for 
the complications that might arise. Attempts at 
this would lead to endless numbers of procedures 
that might, be applied for the complications of the 
admitting diagnosis, This problem was resolved 
by a recognition that any procedure done in a hos- 
pital that was consistent with the diagnosis or the 
complication, or a symptom that the patient might 
have expressed, whether it was found in the chart 
or elsewhere, was an appropriate procedure if it 
did not unnecessarily prolong the stay in the 
hospital. 

Tho complications affecting length of care 
listed were those that we familiarly associate with 
certain diseases such as infections that follow op- 
erative procedures, or pneumonia that follows 
coma in diabetics. 

Tho problems the panels had in establish- 
ing an expected length of hospital stay were not 
nearly so great as we had anticipated. Wo ap- 
proached this with more fear and trepidation than 
afterwards seemed necessary. 

The panel members were knowledgeable 
men working in a field that they had been familiar 
with for 30 years or more. They knew their own 
practices, they knew what they had taught medi- 
cal students and, as a result, it was not a problem 
for them to determine a definite range as to length 
of stay for most, of the diagnoses. This was not 
possible in certain diagnoses, and we knew that it 
would not bo. 

Affecting the length of hospital stay was 
not only the primary diagnosis, but the age of the 
patients and, in some instances, their distance 
from the hospital. These are certainly not medi- 
cal indications, but nevertheless they had to be 



considered by the physician in all instances of 
certain diagnoses, I refer here to surgical patients 
who lived at some considerable distance from the 
hospital; for example, women who were having 
a hysterectomy. Indication for removal of the 
uterus implied that consideration be given to the 
age of the patient, the number of children in the 
family, the size of the uterine mass, and symptoms 
directly related to the presence of the tumor. 

In all but one instance, it was impossible 
for the panels to decide that there was a single day 
of appropriate length of stay. They readily 
agreed, however, upon a length or range of stay 
as being appropriate and, in the case of acute myo- 
cardial infarction, identified the minimum length 
of stay as 3 weeks and left the appropriateness of 
time of discharge to be answered through addi- 
tional criteria that referred entirely to indications 
for discharge, 

It was absolutely impossible to develop cri- 
teria for expected length of stay for the diagnosis 
of diabetes. Diabetics vary too much in the degree 
of severity of diabetes and the ease with which 
physicians gain control of the diabetes or feel 
enough confidence in the manner in which patients 
become familiar with their diet and with the ad- 
ministration of insulin to discharge them. 

In this one diagnosis, diabetes mellitus, the 
evaluation required a physician's judgment as to 
when the patient was satisfactorily controlled for 
discharge. This, I think, was the only diagnosis 
in which I as a physician had to make such a deter- 
mination, In all other instances, the discharge 
criteria were clear enough so that, without exer- 
cising judgment, the appropriateness of length of 
stay could be determined. 

Indications for discharge were relatively 
easily established. In surgical cases the indica- 
tions for discharge were that the wound was not 
infected or had satisfactorily closed, that there 
were no complications of the illness, that the pa- 
tient was ambulatory, and that no elevation of the 
white count, temperature, or pulse was evident. 

Criteria for discharge in the acute myo- 
cardial infarction were also explicitly spelled out : 
that the patient must be free of fever, that his 
electrocardiogram must show no progressive 
changes, that he be ambulant, that his anticoagu- 
lant control be established, that hospitalization 
must have lasted at least 3 weeks or 21 days subse- 
quent to the infarction. I speak of it in this way 
so that you will understand that myocardial in- 
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farctions are not, always an abrupt episode. They 
sometimes develop over several hours, or even sev- 
eral day's time, and in applying these criteria wo 
considered only the date of the established infivrct 
whon the period of medical shock had ended and, 
fi'oiu that time, applied ii weeks more as the re- 
quired length of stay. Patients discharged be Core 
that date were considered as understay. 

Patients discharged in less days than pro- 
vided by the panel were considered as understay. 
If they stayed longer than the range provided or 
longer than the discharge criteria identified, then 
they were considered overstay, 

As we applied these criteria to case ab- 
stracts, a few modifications became necessary. 
This invariably happens when yon apply a new 
tool to a- job ; you find its shortcomings and make 
modification. Modifications were necessary in the 
criteria for conditions of pregnancy. 

The matter of the unusual range of length 
of stay in uncomplicated pregnancies has already 
been referred to earlier today. This used to be 2 
and 8 weeks and is now 5 days or less, depending 
upon the year of study. The panel, which con- 
sisted of two professors ol gynecology and one 
practicing obstetrician, had difficulty in reconcil- 
ing their views as to the length of stay in preg- 
nancy cases. They indicated that admissions 
should be for fi days in mnltipara and 6 days in 
primipara, respectively. However, it immediately 
became apparent as we began collecting data that 
most patients in Michigan were discharged in 4 
days or even less. This brought to light a situa- 
tion that had been difficult for obstetricians to 
resolve that is, the experience of a doctor who 
lived in Detroit and whose practice involved a 
teaching hospital in which the obstetric beds were 
limited in number. As a result, he had to make 
some very practical adjustments to his ideal of 6 
clays. He compromised by discharging the pa- 
tients in this hospital on the third day and pro- 
viding adequate followup care- in the community 
with an excellent visiting nursing service based in 
the hospital. These patients, although discharged 
from the hospital, were followed closely and daily 
for the first week after leaving the hospital. The 
experience with readmissions and complications 
was low enough to convince him that a 3-day stay 
under these circumstances was satisfactory. 
Thereafter, our panel criteria were modified to in- 
clude this briefer stay. 



I would like to make some observations re- 
garding the criteria developed. 

One: they are detailed. I started to say 
"extremely detailed" until I saw those developed 
by Br, Peterson. His are much more detailed than 
we attempted. They are concerned primarily with 
the quality of care rendered patients in the hospi- 
tal, and we are concerned with the length of stay 
and appropriateness of admission. Therefore, the 
criteria were very rigid in regard to admissions 
to the- hospital and flexible otherwise, always rep- 
resenting the range of proper stay or appropriate 
stay in the hospital. 

Detailed provisions are made for variations 
in the patients and contingency of their illnesses. 

The ranges of length of stay are, in general, 
large. 

Some standards, as I have indicated, were 
debatably medical age, distance from the hos- 
pital, available care at home, and the number of 
children. 

Hospital data were then collected by teams 
of medical students and physicians and evaluated 
by three physicians and classified either as "under- 
stay," "appropriate stay," or "overstay." 

Those cases considered "overstay," a sample 
of those considered "appropriate," and all of the 
"understay' 1 were interviewed. These interviews 
were carried out with a total of 842 physicians, 
who were responsible for over 1,696 cases. Only 1 
percent of the physicians refused the interview. 
Two percent were not reached because of deatli or 
having moved from the State. 

After the interview with the physician, who 
supplied about 25 percent more medical informa- 
tion than had been derived from the chart itself, 
a final evaluation of the case was made. The case 
was again identified as either appropriate stay, 
understay, or overstay. In summary, the final 
evaluation showed 2 percent inappropriate admis- 
sions in the 18 diagnoses, that 6.8 percent were 
understfty, that 9.6 percent were overstay, and 
further, that- about 83 percent were appropriate 
stays. 

DISCUSSION 

DR.TRTJSSELL: 

I wanted to ask if the original records were 
not sent to somebody to abstract ? 
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DR. PAYNE: 

I skipped that because time ran out. Ab- 
stracts were made from the chart by teams of 
medical students with a physician in charge, visit- 
ing the 47 different hospitals in the sample. All 
of the cases wore abstracted by the students on 
forms appropriate for each disease and then were 
brought back to Aim Arbor. The evaluation was 
made there by a physician, myself, and two others. 

THE CHAIRMAN: 
Are t hero other questions ? 

DK. E. G. JACO : 

T have two questions. First, Dr. Payne, 
wore any studies made on the decision-making 
process of those panels? "For example, how fast 
and easy or long and difficult was it to reach de- 
cisions about the appropriate criteria for each of 
the categories you discussed, and wore there, 
perhaps, any minority reports, so-called split 
decisions, or disagreements? "What degree of 
consensus did these panels have in arriving at the 
criteria? That, is one question. 

My second question is prompted by the fact 
thattho papers presented today have been focusing 
on (ho overuse of hospitals. However, what about 
(heir nndcruse also, at least from (he research 
standpoint? Can the same criteria, set up for the 
optimum or appropriate hospital use, he used to 
measure under use when such criteria are under 
mot, just as their being over mot would be a case 
of over-use? If (ho rate of overstay were to equal 
the rate of umlorstay, would that mean that the 
hospital in that case would balance out all right? 

IXR. PAYNE: 

There was no .formal study made of how 
quickly or how well the panels arrived at a con- 
sensus. However, I can Hay from personal ob- 
servation, since T was with each of the panels, 
there was a great deal of discussionthere were 
many points of disagreement which wore finally 
resolved by the panels. In one evening they agreed 
in principle upon all of the criteria and then cor- 
rected or approved them as wo mailed thorn later. 
Criteria were developed so that nndcrstays could 
bo identified and, as reported, there were 6.8 per- 
cent of undorstays in this study. 



THE CHAIRMAN: 

As with the other studies, this does not 
show those that should have been admitted but 
were not. It was simply a study of hospital 
population. 

MR. TOM FITZPATRICK (School of 
Business Administration, University of Mich- 
igan now with Hospital Service Association of 
Western Pennsylvania, Pittsburgh) : 

I just wanted to add one thing there is 
an index of the effectiveness of the hospital under- 
stay which was added to overstay but not balanced. 
In fact, I think we got some indication that the 
combination of the two, in sum, is a measure of 
some characteristics of hospitals. 

MR.McNERNEY: 

Although we are talking effectiveness only, 
when you come to mulerstay, it implies that some- 
body is not receiving a service he should this has 
definite, qualitative implications. 

DR.HALDEMAN: 

What, were the characteristics of the hos- 
pitals that had more or less overstay and vmder- 
stay ? Could you tell us also if there was a differ- 
ence in the characteristics of the type of staff and 
the qualifications of the staff? 

DR. PAYNE: 

This was something I had not gone into be- 
cause I was told that you were more interested in 
the development of the technique. However, re- 
sults of the study indicated that largo hospitals, 
those having a large burden of welfare cases, had 
a longer length of stay and more inappropriate 
use of the hospital. This inappropriate stay was 
also increased in hospitals that had a large re- 
sponsibility for teaching. There was a graduation 
of overstay from hospitals with interns alone to 
hospitals with interns and residents, to hospitals 
with interns, residents, and medical students. In 
hospitals where medical students were present, the 
length of stay was much longer. This is a reflec- 
tion not only of the fact that this teaching function 
is present but also that they have a burden of 
welfare cases. Sufficient multivariant analyses 
have not been available to me to resolve this 
exactly. 



THE CHAIRMAN: 

Are there any other questions? 

MR. FITZPATRICK: 

I want to say that we can explain that spe- 
cialists keep their patients in the hospital longer 
than general practitioners. However, there is one 
more interesting figure the inappropriate use 
was greatest in the hospitals of less than 50 beds. 
They had the most underuse and the most com- 
bined underuse and overuse, although they did not 
have the most overuse. Many factors are in- 
volved. However, the hospitals which had the 
greatest degree of appropriate use with regard to 
size wore the 250 to 499 bed institutions. Hospi- 
tals with 500 beds and up had the preponderance 
of welfare cases and a higher age concentration. 
They also had a drastically smaller proportion of 
deliveries to total cases about 11 percent as 
opposed to 18. I don't remember the exact 
numbers. 

These large hospitals also had the greatest 
number of specialists. We measured this by the 
staffs -with less than 25 percent specialists, 25 to 50 
percent, and so on. This group was in the 75 to 
100 percent range and had the internship, resi- 
dency and, in most cases, undergraduate medical 
school training as well. All these factors have, we 
believe, something to do with the pattern of use. 

MR. McNERNEY: 

Do you want to comment on the general 
practitioner and how his behavior changed de- 
pending upon the percent of specialists on the 

staff? 

MR. FITZPATRICK: 

Yes, I think we uncovered as many ques- 
tions as we did answers. However-, with the length 
of time in practice, the general practitioner's use 
of the hospital approached somewhat that of the 
specialist. Similarly, where the general practi- 
tioner was on the staff, the majority of members of 
which were general practitioners, his use was dras- 
tically different from that of the specialist. When 
he was on the staff of a hospital with 75 percent 
or more specialists in practice, with regard to ef- 
fectiveness, use by the general practitioner was 
indistinguishable from that of the specialist, which 
argues, apparently, for a great degree of colleague 
control. 



REPRESENTATIVE : 

Did you have any physicians on the staff of 
the two different hospitals with different charac- 
teristics 3 

DR. PAYNE: 

I am sure there were but they were not 
identified, 

REPRESENTATIVE : 

Was there any chance that the bigger hos- 
pital had more severe cases within diagnostic 
categories ? Was that taken care of by evaluation 
procedure? 

DR. PAYNE: 

It was taken care of by criteria. I spent 
more time on developing criteria than anything 
else because I think this is a central point for any 
such evaluation of care. Also, I would like to 
emphasize that criteria of this nature can. be de- 
veloped for qualitative as well as quantitative care 
and can be applied simultaneously by either a 
staff committee or by a group measuring care 
within a region or within a State for that matter. 

MR. JACOB J. FELDMAN (National 
Opinion Research Center, Chicago) : 

Was any attempt made to correlate the level 
of occupancy in hospitals with understay and over- 
stay ? It seems possible that understays were more 
prevalent in situations of bed shortage and over- 
stays more prevalent in situations of bed surplus. 

MR. DONALD C. RIEDEL (Director of 
Research and Planning, Blue Cross Association, 
Chicago) : 

We tried. I was very much interested in 
this because I was sure in my own mind that it has 
some effect the higher occupancy being related 
to perhaps a lesser amount of overstay or vice 
versa, with perhaps the overstay creating an oc- 
cupancy problem. We attempted to get detailed 
data on occupancy since we were of the firm belief 
that a gross occupancy figure for the entire hos- 
pital was of little use. Therefore, we tried to get 
it by division of the hospital the division of the 
hospital the patient was in. Even that, however, 
isn't good enough. What you really need is not 



occupancy for over a year or a month, but the 
occupancy at the time the patient was discharged 
or admitted, depending upon what you are eval- 
uating. The fact was wo could not get the data. 
We tried, but ended up with only 35 hospitals that 
had somewhat useful data. We could not do the 
entire job well and we let the rest go. 

MR.MoNERNEY: 

I should like to stress the point that the cri- 
teria wo have been discussing are reference points 
which can become oppressive, can become sancti- 
fied, or can be very useful depending on the skill 
of hospital and medical leadership. They repre- 
sent a bold approach to evaluating hospital per- 
formance ou an individual hospital or areawide 
basis. Their potential misuse should be weighted 



lightly compared to the public's persistent cry for 
evidence of effective performance. 

THE CHAIRMAN: 

I think most of you know Paul Densen as 
one of the most experienced biostatisticians. He 
had his training at Johns Hopkins and has been 
involved with the Health Insurance Plan and is 
now deeply involved in a research unit in the De- 
partment of Health in the City of New York. 

Sam Shapiro was with NORC for some time 
and now is Director of Research in HIP. He has 
been involved with Paul Sheatsley in NORC and 
with Odin Anderson in many of their joint activi- 
ties. 

I am going to call on Paul and then I assume 
that Sam will probably follow with his comments. 



HOSPITAL USE UNDER VARYING FORMS OF MEDICAL CARE 



MR. PAUL M. DENSEN (Deputy Com- 
missioner of Health, New York City) ; 

As I was sitting here this morning listening 
to the discussion, I cost my mind back to the situa- 
tion we were in in HIP when we first began to 
think about doing these studies and wondered why 
wo got into this kind of study in the first place. I 
believe it was because we were in a group practice 
organization which a lot of people were watching 
with a great deal of interest. When it was orig- 
inally organized, a great many statements were 
made to the effect that, if you have a group practice 
organization, you should have better medical care, 
and a number of similar generalizations. 

Being somewhat quantitatively minded, we 
thought it would be desirable to see whether some 
of these things were actually happening, and we 
started, to wonder about how you go about looking 
at this. From an ideal point of view, if you were 
in a laboratory situation, you would take a group 
of people and randomize them so that some of them 
would be in HIP and others would go into an- 
other kind of an organization. It is evident, from 
the discussions thus far, that the problem of study- 
ing in some objective fashion the impact of various 
forms of organization and various forms of medi- 
cal practice on hospitalization and on quality of 
care is exceedingly difficult for the simple reason 
that you are not in the laboratory situation. Thus, 



you have to take people as they come and try your 
best to approximate the laboratory situation by 
setting up two groups as nearly comparable as 
you can make them. From that point of view, we 
began to cast around to see whether we could get 
a non-HIP group that was reasonably comparable 
to the HIP group in many of its characteristics. 
It suddenly dawned on us that Blue Cross in New 
York City had in its basic files the kinds of in- 
formation that would be needed to study at least 
the problem of hospitalization. We were not mak- 
ing any assumptions about what hospitalization 
had to do with quality of medical care at that 
point, nor have we made them since, as far as that 
goes. We simply were interested in seeing what 
happens to hospitalization under different ways 
of providing medical care, 

From that point of view, we began to carry 
out the three studies which I shall report. NO\VJ 
I know that this is a very sophisticated and 
knowledgeable audience in this field of health and 
medical care programs and also in regard to re- 
search approaches to these problems, The purpose 
of this meeting, as I understand it, is to look at the 
facts and consider the implications for further 
work. I am going to assume that the studies that 
we have carried out in HIP are well known to this 
audience, so I shall not review them in detail. I 
shall only present the general findings of these 
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studies and then attempt, to cliscws some thoughts 
regarding further work. 



Hospitalization Rate in HIP and Blue Shield 

In the first study we compared the hospit fil- 
iation rate in HIP with those of comparable oc- 
cupational groups insured by some outside agency. 
In this cnsc the program was insured through Blue 
Shield. 

Now, (he admission rate in HIP was 50.6 
per thousand population and in the non-HIP 
group, 77.3 per thousand. 

If you limit the comparison to adults over 
25 years of age (and, incidentally, these are all non- 
obstetrical admission rates) you get the same kind 
of a difference between HIP and the non-HIP 
group. If you include obstetric admission rales 
(as in the original report) you find the same kind 
of picture except that the rates are higher. 

In this study, we were quite aware (hat there 
were differences in the medical benefits provided 
under the HIP program and under the Blue Shield 
program. Under the Blue Shield program the 
benefits of one contract covered largely in -hospital 
and surgical care and in another contract covered 
in-hospital, surgical, and medical care. There 
were a few on t-of -hospital coverages in this par- 
ticular Blue Shield program but, by and large, 
Hie coverage was within the hospital. Again, these 
are detailed in the studies. 

The HIP program provided comprehensive 
medical care across the board. 

The two programs differed, of course, in 
organisation and in the method of paying the doc- 
tors. They were similar, however, in the Blue 
Cross benefits and we decided that we would 
start with this and see what we could learn. What 
we learned is summarized in the rates shown on 
the sheet distributed. 



Dual-Choice Arrangements 

Having finished that study, we cast around 
to see if there was any way we could make the 
comparison a little clearer by controlling some 
of the variables. We found it was possible to 



carry this out in a study of HIP and the Dress 
Joint Board of the International Ladies Garment 
Workers. This Dress Joint Board offered the 
members of the Union a dual-choice arrange- 
ment they could either choose HIP or they could 
choose the Group Health Insurance program in 
New York another non-profit program. These 
two programs were similar in their medical benefits 
and similar in their Blue Cross benefits. They 
differed, however, in organization and in the 
method of paying the doctors. 

In this comparison again we have HIP as 
the group practice program; the other program, 
Group Health Insurance, is one which has a pro- 
gram of participating doctors but has no medical 
care organization for which it is directly respon- 
sible. It works with the doctors in the community 
as does a regular insurance program. In other 
\vords, the medical care is given in the general 
framework of practice in the community. 

Here we have to limit the analysis to adults 
aged 25 and over, and again you will find a differ- 
ence in the hospital admission rates. In this study 
we have been able to eliminate one of the variables 
of the previous study the difference in the medi- 
cal benefits. The medical benefits were exactly the 
.same in these two groups and yei the hospital ad- 
mission rate was lower for HIP than for the non- 
HIP group. 

Now, obviously, one of the things that comes 
up in such a study is the need for a fair amount of 
ingenuity in attempting 1 to find ways of testing 
some of these selective factors which may be 
operating. In this study the question came up: 
What were the selective factors operating which 
decided one part of the Dress Joint Board mem- 
bership to choose HIP and the other part to choose 
Group Health Insurance? 

So far as we could judge, these selective 
factors, whatever they were, were not related to 
the question of health status. I can cite two pieces 
of evidence in this connection. 

Three different locals were involved, and 
the proportions of the union membership in each 
of the locals which chose HIP differed consider- 
ably. One of the locals had a very high propor- 
tion of its membership which chose HIP and the 
other local had a high proportion of its member- 
ship which chose GHI. However, in both of 
those situations, when you look at the data spe- 
cifically for each local, irrespective of the fact 
that proportions which chose HIP differed con- 
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siderably, the rate of admission was lower in the 
HIP than in the non-HIP group. 

"We were also very fortunate at the time of 
undertaking the study that the Health Informa- 
tion Foundation was carrying out a study of 
attitudes toward health problems among these 
same groups of union workers, as well as some 
others. They included the Dress Joint Board 
workers in the program, and their findings became 
available to us. 

Insofar as wo could tell from the data, the 
attitudes of those members who chose HIP and 
(hose who chose GHI with regard to health wore 
essentially the same in the (wo groups. There 
were no major differences between them. 

Furthermore, the previous expenditures for 
health care, which, if I remember correctly, was 
over $500 in the previous year, were the same in 
the two groups. Therefore, wo could not find any 
evidence in this study that the two groups differed 
in regard to their health status. That is the 
factual evidence. 

There is one interpretive comment I might 
add from knowledge of the union situation. It is 
my guess that the choice between the two medical 
care plans by the membership was not so much an 
individual decision as a decision based upon the 
particular attitude of the union leadership. This 
really decided, wo believe, in this particular in- 
stance, what plan the men chose, depending on 
which local they happened to be in. Of course, 
there were differences among the union leadership 
in these locals. 

The third study I want to mention is one 
which has come out fairly recently. It extends 
this attempt to look at different situations and see 
what they do to the hospital admission rate, to 
another dual-choice union situation in this case 
District No. 65 of the Retail, Wholesale, and De- 
partment Store Workers Union. 

The difference between this study and the 
previous studies lies in the fact that in this study 
the union self-insured its membership. It did not 
seek an outside insuring program and it exercised 
a considerable control over the utilization of the 
hospitals by its membership. For example, it 
looked at the bills, and it conducted an educational 
program. This particular union has quite a pa- 
ternalistic attitude it tries to keep its member- 
ship pretty well identified with the union. 

In this third study, the data did not jibe 
with the two previous studies. In essence, we 
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found no difference in the hospital utilization rate 
between the HIP group and the group that 
utilized the union's own program for providing 
medical benefits and hospital benefits. 

Again, we had similarity in medical benefits 
and similarity in hospital benefits but difference in 
organization and in payments to the doctors. 

I think it is important to note that, although 
there was no difference in hospital utilization in 
these two groups, the hospital admission rates 
themselves are very low. We did everything we 
possibly could to test the hospital admission rate 
to be sure we had not left out any hospitalization 
that should be included either in the HIP group 
or in the non-HIP group. These are covered 
in detail in the report. However, so far as we can 
tell, the kind of adjustments which were made in 
analyzing the data did not raise the rates by but a 
very small proportion of the total. Therefore, 
we find again that we have low hospitalization 
admission rates. 

The suggestion this study carries is that 
there are ways of controlling hospital admission 
rates other than group practice. 

Again in this study we have to consider 
the question of the possible selectivity of who 
chose HIP and those who remained with the 
union's own plan. We were able to look at this in 
this particular situation by looking at the out-of- 
hospital utilization of the HIP group and the 
non-HIP group. So far as we could discover, 
when we looked at the out- of -hospital utilization, 
these were essentially the same in the two groups. 

Now, these are the basic findings. There 
are still some residual questions that can be raised 
about the findings of these studies. I would like 
to comment on them specifically. These residual 
questions concern the availability of beds and the 
classification by hospital appointment. We went 
back to the 1955 data and made some special tabu- 
lations on this. 

In the Blue Cross-Blue Shield study, the annual 
hospital admission rate is 77.3 per thousand for 
Blue Shield and 59.6 for HIP. We then classify 
the medical groups by hospital appointments. In 
the medical groups where at least two-thirds of 
the family physicians have appointments on the 
staff of one or more voluntary or proprietary hos- 
pitals, the rate is 62.2 per thousand, still a lower 
rate than in the Blue Cross-Blue Shield. 

In medical groups where at least one-third 
of the family physicians have appointments as 
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associate or attending physicians, the rate is about 
the same as in the previous group and still lower 
than the Blue Cross-Blue Shield. 

Hero yon have a situation in which what- 
ever one of these sets of medical groups you choose 
to look at, chances are pretty good you would 
have no problem of getting this person into the 
hospital. There is, however, an indication that if 
the family physicians do not have the hospital 
appointments, this mil have an impact on the hos- 
pital admission rates because for the medical 
groups where two-thirds or less of the family 
physicians have appointments on the staff of one 
or more voluntary or proprietary hospitals, then 
the rate goes down to 53.1 per thousand. 

This suggests that in those medical groups 
there is a problem of getting the patients into the 
hospital. However, if you limit the analysis to 
those having no problem in staff appointments, 
you still have a difference in the HIP and non- 
HIP comparison. 

What about the question of access to hos- 
pital beds themselves? There are some medical 
groups in HIP where thei'e is ample evidence that 
getting the patient into the hospital presents no 
special problem. Here you get an admission rate 
of 67.4- per thousand. The overall rate of 59.6 is 
increased, but it is still lower than that in Blue 
Cross-Bine Shield. 

In the rest of the medical groups, the rate 
drops back to 57.8, again suggesting there may be 
something in the argument that the overall low 
rate is partly clue to the fact that you do not have 
access to hospital beds. But if we take these data 
as they stand, it is hard for me to see how access 
to hospital beds in and of itself can account for 
the differences we have in the two studies. It may 
be a contributing factor, but it does not account 
for all of the differences. 

I might say in passing, though, that I have 
other data here to indicate that the overall stay in 
the hospital in all of the studies was essentially 
the same in the two comparison groups both as 
to average length of stay and distribution of 
length of stay. 

Now, where do we go from here relative to 
these kinds of studies ? We feel in New York City 
that the hospital admission rate in HIP is lower 
lian it is in the non-HIP situation, when you 
nftlce the groups as comparable as you can, 

I think we need to make further attempts to 
control the variables in the HIP comparison. We 



have to examine other situations and see whether 
this continues to hold up. There are other situa- 
tions arising in the development of the HIP pro- 
gram which may make it possible to do this. I 
think that Mr. Shapiro is planning to look at this 
when sufficient data have been accumulated to 
make it worthwhile. 

For example, there is now a dual-choice sit- 
uation among State and Federal employees and 
this makes it possible to make another comparison. 
There will undoubtedly be other kinds of occu- 
pational comparisons arising which will make it 
possible to continue to test the effect of group 
practice on hospital utilization. 

We think that the differences between the 
HIP and non-HIP admission rates that we have 
observed in New York City are real. There is, 
however, still a great need to determine whether 
group practice in general leads to lower hospital 
utilization. Would this be true in other parts of 
the country, in other kinds of group -practice sit- 
uations, and in other kinds of comparisons? 

Now, I would like to comment amply on the 
methodological technique used in this study. You 
will notice that basically in the first study we used 
the Blue Cross files. You have to have a denom- 
inator to set the numerator against and you have 
to be sure, as sure as you can be, that you are get- 
ting all the pertinent cases into the numerator. 
It is not an easy job to do. It sounds easy until 
you try it and begin to think about the question of 
how people can be missed in the numerator and 
in the denominator. Constant attention must be 
given to this problem. 

In connection with studying the variation 
in hospital admission rates by different kinds of 
coverage and different kinds of medical care or- 
ganizations, there are many instances right in the 
files of Blue Cross which lend themselves to analy- 
sis because of the very nature of Blue Cross. We 
now have the Group Health Association of Amer- 
ica too, which has a large number of group prac- 
tice organizations in it. Some of the group prac- 
tice organizations have now grown to a size where 
it is worth while taking a look at the experience 
of these groups. These large group practice or- 
ganizations must have available in their records 
the basic information to carry out studies of hos- 
pitalization because of the nature of the plan. It 
isn't as though the material wasn't there it is. 
But we need to find a way to organize it, to get at 
it. This, of course, requires large scale replicated 



studies in specific geographic areas. Two organ- 
izations which are in an excellent position to initi- 
ate such studies across the board are the National 
Rlue Cross organization and the Group Health 
Association of America. If they were to pool 
their resources and (heir experience, they could 
hike us a long way further into looking at some of 
these difficult, kinds of problems. 



Research Requirements 

MB. SAM SHAPIRO; 

What I should like to add to Paul's thor- 
ough review of the studies on hospital utilization 
conducted at HIP concerns some of the research 
requirements that emerge 'from these experiences. 
First, it would appear that comparison studies of 
the typo described should be prepared for small 
but important differences. The margins in the 
first two sets of comparisons presented wore 15 to 
20 percent and these could easily have been missed 
if large samples had not "been used. Sometimes 
small samples will, of course, yield results con- 
sistent with findings in large-scale studies even 
where (ho expected differences are small. One 
such instance is the Health Information Founda- 
tion study referred to earlier by Paul. Here 
chanco worked in its favor. The samples were 
small but the differences were substantial and 
stood the test of statistical significance. Actually, 
the odds were heavily against a statistically sig- 
nificant finding considering the 15 to 20 percent 
differences demonstrated in the HIP studies, 

Another point that becomes clear when one 
considers the small margin usually under investi- 
gation and the many circumstances that may he 
influencing it, is the desirability of making com- 
parisons between populations subject to similar 
local area conditions. The significance of this fac- 
tor is apparent in view of the known variability 
of hospital admission rates and duration of stay 
by geographic area* One of the strengths of the 
HIP studies was the fact that the comparisons 
involved groups in the same city. 

Leaving methodology aside and turning to 
questions that are raised about the HIP studies, 
there are two issues I want to comment on. One 
of them concerns the accessibility of HIP physi- 
cians to hospital beds. This point has already been 



covered by Paul, but it is worth adding that in 
selecting the category of medical groups "with no 
special problem in gaining access to hospital beds," 
a stringent set of criteria was used. Only six med- 
ical groups are included and, judging from what 
we know about the hospital appointments of their 
family physicians and specialists, there is a very 
little reason to believe that the HIP physicians 
have a more difficult time than other physicians 
in the community in gaining access to hospital 
beds. The fact that the hospital admission rate 
for these medical groups is below the rate for 
Blue Cross-Blue Shield is fairly convincing evi- 
dence that the lower hospital utilization, rates in 
HIP cannot be explained away on the basis of 
differential accessibility to hospital beds. 

The other question often raised, and Dr. 
Klarman wrote to me recently about it, is how does 
it happen that despite the lower admission rates 
in HIP for short-stay diagnostic categories such 
as respiratory diseases, the overall average dura- 
tion of stay does not differ appreciably for HIP 
and the comparison groups. In an attempt to 
answer this question, we recently went back to the 
early study material and examined duration of 
stay for various diagnostic categories. Our inter- 
est was in determining whether there was any pat- 
torn in duration of stay for those conditions where 
HIP had appreciably lower admission rates than 
Blue Gross-Blue Shield. Briefly, no consistent 
patterns were found. In part, this may reflect a 
shortcoming of our diagnostic groupings. Per- 
haps some of the results of other hospital studies 
will suggest better combinations of diagnoses. 

THE CHAIRMAN : 

We now come to the last panelists foi 1 the 
afternoon. Dr. Trussell is Commissioner of 
Hospitals of New York. He is on leave from 
directing the School of Public Health and Admin- 
istrative Medicine at Columbia. He is continuing 
to do that in any spare moments lie has. Of 
course, how he has any spare moments, I do not 
know, Having lived in New York, I might say 
that lie is doing some remarkable things in revising 
the direction of the municipal hospitals in that 
community. Also, it seems to me that about once 
a month a new major study lias been reported by 
Dr. Trussell and his associates. 

Jack Elinson and Miss Williams also are 
members of the faculty at Columbia, They are 



59 



exports in survey research. Jack, I know, was 
involved with Dr. Trnssell, when he was at the 
National Opinion Research Center, in the studies 
of chronic illness curried on in connection with 



the Commission on Chronic Illness. 

I will call on Dr. Trussell and. ask him to 
say anything he wants and then also give Dr. 

Elinson and Dr. Williams their assignments. 



THE USE OP RESEARCH DATA IN" HOSPITAL AND 

COMMUNITY PLANNING 



DR. KAY E. TRUSSELL: 

George asked me to do a kind of panoramic 
review of some of the things we have gone into 
and then let Dr. Williams and Dr. Elinson com- 
ment on some of the specifics. Because of my 
present frame of reference, that of being an ad- 
ministrator and trying lo resolve some problems 
which sometimes seem insoluble) I perhaps am 
going to emphasize a little more the application of 
research than just the conduct of the research. 

To understand what we are doing at the 
School of Public Health and Administrative Med- 
icine at Columbia f it is necessary to keep a few 
points in mind. These are very simple points but 
they help to got our ideas into perspective. 

We think that we exist to examine public 
problems and to train people to deal with them, 
through research and through administration. 
Furthermore, as a part of the University, which 
is in turn a part of the community, we also think 
we have an obligation to resolve some of the com- 
munity problems to the extent that it is feasible 
fo do so. Nadu-ally, we are involved in a lot of 
local problems and work. Some of the work that 
we do is at our own initiative because of its aca- 
demic interest. Dr. Elinson is going to review 
briefly one such study when I am through. 

Most of our work in (he last few years has 
been in response, to some rather pressing problems 
felt by the State of New York, by the Puerto Rican 
Commonwealth, by the City of New York, and by 
management and labor working' log-other either as 
trustees ol pension and welfare funds, or through 
a foundation. Di*. Williams is going to run over 
one of the latter studies, 

Our work in New York State, particularly 
in Now York City, is concerned with problems 
which quantitatively are. somewhat peculiar to our 
local area. However, the qualitative issues that we 
aro dealing with arc certainly national in scope, 
if not international. 



It is gratuitous to point out to this audience 
that the kind of work we are talking about is time- 
consuming-, expensive, and multi-disciplinary in 
nature. The way in which one attacks a problem 
depends in large measure on what is available in 
terms of data and funds, the technical develop- 
ments in the field, and the importance of the prob- 
lem in relation to the data to be gathered. 

My impression is that we have to make 
more use of existing unpublished data, as Dr. 
Densen has said, while separately we go on refin- 
ing methodology. Today we have been discussing 
some good examples of both efforts. 

Finally, I might say that at Columbia we 
are a group who enjoy doing something about the 
problems we study. This enthusiasm is not uni- 
formly shared by certain hospitals or physicians 
in New York. (Laughter) Nevertheless, both in 
the State and in the city, in the Department of 
Hospitals and in the Department of Health, 
major policy decisions and program implementa- 
tions are being made on the basis of the kinds of 
research we are talking about today. This is a 
healthy trend, provided research does not become 
perverted into a basis for indecision. 

At this point I would like to summarize 
some of the things we have been into and then ask 
Dr. Williams and Dr. Elinson to add their com- 
ments. Then we will answer questions. 



Hospital Use for Narcotic Addiction 

One c-f the earlier studies we undertook in 
connection with hospital use was in a highly spe- 
cialized area, namely, the field of narcotic addic- 
tion. New York City has the only hospital op- 
erating exclusively for the care and treatment of 
adolescent addicts : Riverside Hospital. It is a 141- 
becl facility on an island in the East River, set up 10 



years ago as a result, of community hysteria about 
juvenile addiction. Because Hie patients are ado- 
lescents, I hey qualify for State aid under an inter- 
pret ation of the State Health Department Medical 
Behabilif ation program, and 50 percent of the cost 
of their care is provided through State aid to the 
city. Wo were asked to do a rather empirical eval- 
uation of what the Health Department was getting- 
for its money in supporting the use of this hospital. 
Wo retained, under the general direction of Dr. 
Elinson and myself, a sociologist find a sociology 
student. In 1958 they studied the hospital use 
f-o find the statistics with regard to the people who 
had heen admitted to the "Riverside Hospital for 
the first, time in 195(5. 

Well, a year-and-a-half later, ns I recall it, 
we had some most disturbing data about the use 
of this hospital and, I might say, its uselessness. 
Of (he people who had been admitted for the first 
time in 1955, Jl had died. These were all under 
tho age of 21, in a population of 255. 

Half of the time after the first discharge 
from tho hospital, these patients were back in tho 
hospital or back in jail. Half of the time they 
were in the community they were on drugs. Only 
eight never returned to the use of drugs, and they 
swore they had never been addicted. They were 
caught in possession of heroin and were committed. 
They put, in their timo and left, and that was the 
end of tho experience. 

As a result of this particular very empirical 
assessment, which resulted from a very strenuous 
effort on f he part of two social scientists to find and 
interview these people (and we have tape-recorded 
interviews from 147 of them and recorded evidence 
on 94 percent of them), the City made a policy 
decision to move it s narcotic treatment program to- 
ward research, prevention, short-term detoxication, 
and aftercare and to negotiate with the Slato for 
assumption of long-term treatment responsibili- 
ties. An announcement to this effect will bo made 
within the next few weeks and I will be closing 
"Riverside soon. 



Health Insurance Plans 

The second State problem that wo got into 
had to do with the study of various health insur- 
ance plans in the State. This came about because 



in 1957 the Blue Cross Plan in the New York City 
area asked for a, premium increase with very lit- 
tle public preparation. A public hearing was held, 
und it was quite a traumatic experience for all con- 
cerned. The rate increase was denied. Blue Cross 
promptly filed again, another public hearing was 
held, and again the conflict and tho lack of facts 
were obvious. However, the financial data were 
also becoming more convincing and the rate in- 
crease was given. However, the carriers were 
called in and were asked to support a study of the 
health insurance plans in New York State by cori- 
(rihuting voluntarily $150,000 prorated among 
them according to the premium involved. Well, 
they swallowed that- manfully and went back and 
volunteered the $150,000. I wish I could finance 
all of my research this way. As a result, we were 
retained by the State to undertake a rather inclu- 
sive study of the various plans. 

Our first effort was devoted to Blue Cross. 
Wo had about 20 people representing 11 different 
disciplines working on this particular study. In 
the area of hospital utilization we worked primar- 
ily with data which were readily available or could 
be made available by the plans or by some special 
studies that could be designed and carried out 
within a reasonable time and at reasonable 
expense. 

Wo were concerned with tho need for ad- 
missions, as Dr. McNerney's team has been. We 
did not do definitive work here. We were just 
looking for leads. We read records in several 
hospitals and it was quite obvious there were people 
going in who did not need to be there. However, 
we did not come to any definitive conclusion as to 
what proportion of people did not need to be 
admitted. 

Tho length of stay data probably was of 
more interest to us than any other single thing. 
We compared, on a statewide basis, the length of 
stay of people admitted on Tuesday and people ad- 
mitted on Friday. Briefly, in large hospitals 
which handle a very large volume of Blue Cross 
work, the average length of stay in the hospital 
will vary anywhere from 2 to 4 days longer among 
people admitted on Friday than for people ad- 
mitted on Tuesday. The reasons, I believe, are 
self-evident. This has to do with the general 
shut-down of activity of the hospital over the 
weekend. 

We did another interesting study of several 
thousand people in the New York City Blue Cross 
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Plan who had stayed more than 21 days. When 
a patient is admitted to a hospital in New York 
City under the 21-day Blue Cross contract, 180 
days of hnlf coverage are also available to him, 
and he is certified originally for 51 days of care, 
21 full coverage and 30 half coverage. On the 
fifty-first day, the administrator of the- hospital 
has to certify to Blue Cross that the patient needs 
to be in the hospital. 

We followed the discharge rates of several 
thousand people who had stayed longer than 21 
days. They went home each day at the rate of 
2 percent, 3 percent, 4 percent, until the 51st day. 
On that day 45 percent of the patients went home. 
Out of the Blue Cross study came the gen- 
eral conclusion that hospital cost per unit of serv- 
ice would continue to go up for obvious reasons 
which we described, that unnecessary hospital con- 
struction was a threat to both the survival of volun- 
tary systems and to the survival of Blue Cross, and 
that it should be dealt with at the local regional 
level through community planning. 

As a result of this, the State legislature cre- 
ated the State Hospital Review and Planning 
Council and the Governor encouraged the forma- 
tion of regional councils which are supposed to co- 
ordinate their work with the State Council. Cur- 
rently in New York State we are involved in a bit 
of a strained situation about giving the regional 
councils the authority that we really think they 
should have to do planning, to investigate unnec- 
essary- building and, at the same time, to encourage 
necessary building. 

The proprietary hospital problem in New 
York City is a particularly severe problem, as Mr. 
Bugbee can tell you. Twenty-five percent of the 
private practice beds in New York City are pro- 
prietary. In the last few years I have been writ- 
ing reports which are aimed at the Commissioner 
of Hospitals, and now I find myself in the odd 
position of getting my own reports because I li- 
cense these proprietary hospitals. Consequently, 
we have been taking an administrative position 
that future proprietary hospital expansion will 
not be done until after consultation with the re- 
gional council, 

I have recently turned down several ap- 
plications for expansion of proprietary facilities 
ind have negotiated three programs that were 
artially underway into a smaller expansion. The 
hole proprietary hospital building situation in 
"ew York City is tending to stabilize. However, 



outside of New York City, where I have no au- 
thority, the problem is that of the State Board of 
Social Welfare, where the proprietary building 
situation really presents a gloomy picture as far 
as those of us associated now with Blue Cross are 
concerned. 

We also took a look at what kinds of hos- 
pitals are used and paid for through Blue Cross. 
As a result, we drew attention to the fact that in 
the particular year under study, 1958, something 
like $23 million went to unaccredited hospitals 
and, of this, 70 percent went to unaccredited pro- 
prietary hospitals. We recommended that Blue 
Cross adopt a policy of not paying proprietary 
hospitals if they are not accredited after 3 years. 
Blue Cross thus far has adopted a policy of not 
accepting any new member hospitals who do not 
become accredited as soon as they are eligible to 
do so. 

After I became Commissioner, the Board 
of Hospitals, of which I am chairman, passed a 
resolution, requiring proprietary hospitals to be- 
come accredited within 3 years as a condition of 
being relicensed. Since then, quite a few have be- 
come accredited. 

Now, in the meantime, I had long since used 
up that $150,000 and we had to bring together 
other funds and studies, plus a great deal of con- 
tributed services from Blue Cross, Blue Shield, 
GHI, HIP, doctors, and others, to finish our con- 
tractual obligations. We brought out a second 
and final report dealing with the medical and 
dental care plans. This report is not as complete 
as we would like it to be. There were limits as to 
how long we could stay afloat and still attempt to 
balance the deficit accounts as a result of this last 
book, but it certainly was worth it. 

In this particualr study we again got into 
some of the areas touched on today in techniques 
which have the same basic premise, that of peer 
judgment. The question is, how do you get the 
peer judgment? How do you analyze it and then 
report it? 



Household Survey 

One of the studies that we undertook for 
labor-management groups was also published in 
this report. The Teamsters Joint Council No. 16 
and Management Hospitalization Trust Fund had 



retained us to do a household survey study and 
medical audil. They wanted a .sample of 100 per- 
cent hospitalized patients, so we asked Blue Cross 
to give us a sample of people from some 21 locals. 
This is a very large population, well over 100,000 
people, who had in a 0-month period a hospital hill 
paid for a staled number of- conditions. 

This work was done hy surveyors in the 
Now York City area who had boon doing this kind 
of work for a great number of years and wore 
experienced in medical auditing. The work was 
directed by Dr. Morehead, who previously had 
been the director of the quality studies Cor HIP. 
Most of her surveyors in (his study were people 
who had been working with her for 8 or 9 years 
and had surveyed every specially within ITIP. 
Thus, we wore dealing with seasoned researchers 
who had been through the mill. Little of that has 
ever boon published because the groups have voted 
it down each time it was ready for publication. 
However, T think most of you have seen some of 
the data which came out of that study. 

The estimates for these selected diagnostic 
categories cannot be generalized to all of Now 
York City but can be generalized lo that largo 
group of teamster families. There was a sub- 
stantial amount, of surgery for which there was no 
indication. For example, in HO consecutive hys- 
terectomies 20 wore deemed to be unnecessary. 
For most, a dilation and curettago (I) and C) and 
Pap smear would have boon preferred before tho 
hysterectomies were done. 

One patient, had a labial cyst which could 
have been examined and dealt with under general 
anethesia. However, the surgeon proceeded to re- 
move a perfectly normal uterus with absolutely no 
indication. 

Another doctor, in order to live up to the 
consultation requirements of the Joint Commis- 
sion for his own hospital, had a consultant see the 
patient. He indicated that no surgery was neces- 
sary, that a T) and G and a Pap smear was indi- 
cated at this time. Nevertheless tho surgeon went 
ahead and did the hysterectomy. 

We are woll aware that if some 60 consecu- 
tive hysterectomies are reviewed by several differ- 
ent physicians, there will be some differences. 
What has never been illuminated in this field is 
how -wide a range will occur in a group of sur- 
veyors who have had some orientation as to the 
nature of the work which they are being asked 
to do, who are supervised to be sure that the forms 



which they are expected to complete are completed. 
Our surveyors not only are requested to fill out a 
standard list of questions or "no" answers, but 
they are also given an opportunity to write an 
essay on the case. 

Our next effort in this field is to move into 
the broad area of inter survey or differences. We 
are working with the State Medical Society and 
tho State Health Department across the State of 
New York in various medical centers in an effort 
not only to illuminate this problem of interviewer 
differences, looking at identical records, but also 
to stimulate the interest of physicians in medical 
auditing in several upstate centers as well as in 
New York. The Teamsters group referred to 
earlier are going to pay for this work. They 
were so interested in the results of the study of 
their own members that they have asked us to go 
on monitoring their medical care. In addition, 
they are willing to support our research in this 
field. 

Another utilization study which was bused 
on available data was a study of 400,000 surgical 
claims paid for by either Blue Shield or Group 
Health Insurance, or which were provided under 
the HIP system. In this case, we had a stratified 
and representative sample of all the surgery in 
New York State during the defined period of time 
paid for by the three plans. We had the name of 
(he doctor, the name of the hospital, and the pro- 
cedure performed and we looked up the sponsor- 
ship and professional standing of hospitals. We 
also looked up the training of doctors and then 
did a variety of analyses. 

Briefly, as an example and sticking to my 
New York City situation, one finds a range from 
a hospital where 90 percent or more of the surgery 
is done by physicians whose qualifications are re- 
corded, namely board-certified or members of the 
College, down to one proprietary hospital which 
is currently licensed and where only 5 percent of 
the surgery is done by doctors who have these 
qualifications. 

Another study which we did in the area of 
quality of medical care, I am going to ask Dr. 
Elinson to talk about. This study, which we 
thought would be useful in guiding people who 
seek advice as to what kind of doctors and hos- 
pitals to go lo, undertook to find out what doctors 
do for themselves or their families. It covered 
the New Jersey State Medical Society membership 
and is a very revealing study, It shows some 
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sharp discrepancies between what physicians do 
for themselves and their families and what they 
do for patients in the community at large. 

The reaction to release of these studies has 
hpeti quite marked. The release of (he report 
was under the control of the superintendent of 
insurance, who pui it out accidentally 2 days be- 
fore he had copies available for other people. 
However, it went to the press and he held a press 
conference. Consequently, everybody became ter- 
ribly upset because they could not get their hands 
on the report and could not comment. 

Four county medical society presidents thus 
far have publicly attacked me without reading 
this report. This is a real testimony to their sci- 
entific acumen to bo able to criticize a 311-page 
report without reading it. Since then one has been 
attacking mo after reading it, but the critiques 
are just as subjective. 

I think that when this all simmers down it 
will bo well-known that T favor the hest in medi- 
cine and that as Commissioner of Hospitals I have 
not only a professional responsibility but a City 
Charter responsibility to deal with the standards 
of care in those institutions under my jurisdic- 
tion. As Mr. Bugbee said, we have some very 
strenuous efforts underway in New York City to 
upgrade hospital care at least in two systems: 
proprietary hospitals and municipal hospitals. 



Puerto Rican Study 

Another major effort in which we became 
involved several years ago grew out of the concern 
of the. Governor of Puerto Rico with the medical 
care situation there. He was receiving an increas- 
ing number of complaints from newly emerging 
middle class Puerto Ricans about the medical care 
problems they faced. As a result, we were com- 
missioned by legislative action to do a 3-year study 
at a cost to the Commonwealth of $300,000. 
This was an all-inclusive set of studies: I will 
allude to two things we did iu connection with 
utilization. 

One of them was an island-wide household 
survey. There are certain answers you can only 
got by including a survey of the community. 
Otherwise you never know what their out-of- 
nocket costs are, how much care they get, where 



they get it, from whom they get it, or what their 
attitudes are. Therefore, we did a household in- 
terview survey of almost 3,000 families. 

At that time, 1958, 90 percent of the hos- 
pital care in Puerto Rico and two-thirds of the 
ambulatory services were either provided directly 
by the Government or paid for by the Govern- 
ment. With this kind of picture and the fact that 
Blue Cross had been in existence for 12 years and 
still was only covering 5 percent of the population, 
one could not be very sanguine about waiting for 
the voluntary approach in this particular part of 
the United States to deal with the very severe 
problems which turned up in a medical audit un- 
dertaken for us by a team of Puerto Rican spe- 
cialists. The then President of the Puerto Rican 
Medical Society, who is a well-qualified internist, 
headed up the team. 

The interest of industry and labor in the. 
medical care field led to a Foundation on Em- 
ployee Health, Medical Care, and Welfare. Dr. 
Williams has been conducting a large study for 
this Foundation for several years. First, a pilot 
study was done in the New York area of a sample 
of District No. 15 machinists. She started with 
just a representative sample of those people within 
a defined area and attempted to find out what kind 
of coverage they had, and then to take ill all the 
other elements we wanted information about. 
This presented quite a problem, and she switched 
her research plan for the larger study, winch has 
recently been released, to people with known cov- 
erage. She will tell you about it after I get 
through. 



Other Research Activities 

We did another study for the hotel industry 
in New York, which has never been published 
because they have made a commitment to us to let 
us resLucly their employee families after their 
new program has evolved. The hotel industry 
had negotiated with the labor union a new fund 
for the coverage of dependents and spouses. The 
president, of the labor union did not want to take 
advantage of any of the existing health insurance 
coverages or schemes in New York City. There- 
fore, we did a household interview study of about 
300 families and came up with results that are fre- 



quently found in New York City, namely, that 
for people who have health insurance, about 25 
percent of tho hospiUxlizations arc iu non- 
accredited proprietary hospitals; 25 percent of 
the doctors that people think are specialists, are 
general practitioners, etc. They were so dis- 
gruntled with the profile of care presented as a 
result of this survey that they made a policy de- 
cision to go into their own full-time group prac- 
tice. Tliis group practice now has the first of 10 
units open and operating. The doctors arc all 
on a full-time salaried basis and they have a very 
interesting provision in their contract, namely, 
that 25 percent of their time is made available to 
the hospital or medical school with which they are 
affiliated for research, teaching, or service. This 
was a policy decision made in an effort to keep 
the doctors up to date as the years go by. 

Now, to go back to tho Teamsters for just a 
moment. The outcome of (ho course which we 
put on for them about hospitals and (he household 
survey we did, which indicated the kind of hos- 
pitals and doctors they were going (o, led them to 
realize that their problems are indeed those of (he 
community. They now are going to sptm<l their 
time and money supporting research, attempting 
to do things for their own membership through 
existing community resources, supporting medical 
auditing, member education, and community- 
oriented developments. They muy even- support a 
hospital research center. 

At Montefiore Hospital, in cooperation with 
our School, a Teamster Center has been opened 
where they can refer anybody whose problems are 
not resolved. The people who come here are those 
who have not been able to solve their problems in 
any other way. Out of the first 50 individuals 
who walked into this center, four were found to 
have the following conditions : One had active TB, 
one had leukemia undiagiiosod, and two had cancer 
of the rectum undiagnosed. All had "good" in- 
surance coverage and were under active medical 
care. The result of this is that the Teamsters are 
convinced their members have some real problems, 
and they are sending people at a faster and faster 
rate. 

I would now like to mention a few more re- 
search activities having to do with hospital use. 
In New York City we have a Health Research 
Council, which is a municipally supported version 
of the National Institutes of Health. One of their 
priority areas is medical care. At Columbia we 



are fortunate in having a team headed by Pro- 
fessor Van Dyke, whose team is doing a series of 
studies of medical care provided by the city. One 
is a study of long-stay patients clone at my request 
to help me explain some the problems to the Budget 
Director and the Mayor. They have just com- 
pleted a study of patients who have been in a 
sample of voluntary hospitals and n sample of 
municipal hospitals for 30 clays or longer. 

In that category of patients, for example, in 
tho municipal hospitals, 50 percent of the patients 
were judged by an outside team of internists, 
social workers, and nurses not to be in need of 
general hospital care. Some could go home, and 
others could go to foster homes, to home care, or to 
nursing homes. This study has identified a whole 
series of problems which confront me and the City 
administration in dealing 1 with this kind of patient. 

For example, we are closing np substandard 
nursing homes faster than building new nursing 
home beds. We do not. have enough social 
workers. Also, not all doctors are interested in 
following through on discharge plans for their 
patients. The administration becomes so used (o 
an individual that sometimes you will find a 
patient, who has been there for 2 years and has 
become sort of a pet of the staff. Also, even in 
the voluntary hospitals, which have a groat deal 
more flexibility regarding which patients they take 
or do not take., 20 percent of the long-stay patients 
did not need to be in an acute general hospital. 

Mr. Van Dyke and his team are now doing 
a study of what we call tho Charitable Institution 
budget populations. They are starting with the 
Blue Cross 1-clay census study in which the mu- 
nicipal hospitals participated as well as the volun- 
tary and proprietary hospitals. Indigent and 
medically indigent patients are paid for on my 
authorization from the Charitable Institutions 
Budget at a rate of $30 a day. This totals $58 
million a year that we are paying to voluntary 
hospitals. We anticipate that we will find some 
very interesting things as to length of stay and 
about people being in the right and wrong hospital. 

Our point of departure, as I said, is the Blue 
Cross one-day census, where we have this across- 
the-board listing of every patient in every hospital 
in New York on a given date. The team and Blue 
Cross have gone back and completed the length of 
stay data on every patient that we are concerned 
with in all hospitals, They are now in the proc- 
ess of looking up all the factors as to length of 



stay the kind of doctor who took care of them and 
also whether they were on approved services or 
unapproved services. I think that, out of this 
will come a number of very interesting policy de- 
cisions. You know, you find some interesting 
things when you do research. For example, in the 
long-stay studies we did notify the hospitals on 
Friday that we were coming on Monday to study 
long-stay patients. On Sunday one discharged 
seven, long-stay patients. 

Finally, Dr. Elinson is in charge, in the 
Washington Heights area where our school is lo- 
cated, of a master sample. He has 6,000 house- 
holds representing a large area of the city from 
which ho can draw any kind of sample that may 
be needed and he is helping with a parallel develop- 
ment in Puerto Rico. I would like to have him 
speak further about that and how lie ties in a 
variety of studies, including some interested in 
medical care. 

He has also been directing a study of the 
use of dental assistants, and helping with a study 
of overhead in group practice versus solo practice. 

DR. JACK ELINSON: 

I should like to touch briefly on selected 
aspects of three of the studies that Dr. Trussel 
mentioned. One study has to do with how New 
Jersey physicians choose medical and hospital care 
for themselves and their families. The second 
study has to do with a household survey of medical 
care in Puerto Rico. The third study has to do 
with a community health survey in a highly urban 
area (the Master Sample Survey in the Washing- 
ton Heights Health District of New York City). 

A common thread that appears to run 
through each of these studies is that the pattern of 
medical and hospital care obtained is (quite apart 
from the question of "needs for care") a function 
of social group membership occupational, socio- 
economic, or even religious. 



New Jersey Physician Study 

The New Jersey study of physicians is one 
of a class of studies bearing on the subject of the 
quality of medical care. Studies of the quality of 
medical care are of three types. We have heard 



today mainly about two. One type depends upon 
ratings of professional performance. These 
ratings may be very global or very specific. Dr. 
Peterson's studies in North Carolina and at Har- 
vard are prime examples of both global and specific 
ratings. The ratings are of physicans' perform- 
ance; and the ratings are made by physicians, 
using more or less objective criteria. Neverthe- 
less they are ratings of performance which may be 
interpreted as measuring or reflecting the quality 
of medical care. 

Another type of study uses the professional 
characteristics of physicians and hospitals as 
yardsticks of the quality of care. Dr. Trussell 
described (his type of study. Physicians are 
characterized in terms of such matters as whether 
they are board-qualified or not; hospitals are de- 
scribed in such terms as whether they are teaching 
hospitals or not, accredited or not. There is an 
underlying assumption in this type of study of 
a hierarchy of professional characteristics pre- 
sumed to be related to quality of care. 

A third type of study, which has been 
touched on here only to allude to the fact that it 
is extremely difficult to do and has not often been 
done, is what may well be called the "so-what" 
study. "So-what" that medical care is provided by 
Peterson's physicians whose performance is rated 
as being in accord with the currently accepted 
practices of medicine? "So-what" that medical 
care is delivered by Trussell's qualified specialists 
in accredited teaching hospitals? Should not the 
question be: What do medical care and hospital 
care however they may be rated and whatever 
their professional character may be do for pa- 
tients? Paul Densen is among those who have 
pointed out that "so-what" studies are not done 
because no one has figured out a way to link a 
particular pattern or quality of care with the 
health status oj: a patient and his social function- 
ing. The pioneering studies that Densen and 
Shapiro have carried out, utilizing special popula- 
tion groups matched on various characteristics but 
receiving care under different social arrangements, 
represent an attempt to approximate the condi- 
tions of more rigorously controlled studies. 

The Columbia study of physicians in New 
Jersey is still another kind. Again, it is not a "so- 
what" study. It is, rather, a study of (he behavior 
of connoisseurs of medical care. It asks what 
physicians do in a real situation, when they are 



confronted with a decision nboui choosing medical 
cure for themselves and their families. What do 
phynioian* do? "What kind of physicians do 
physicians use? "What kind of hospitals do they 
go to? Tho study is not a u so-\vlmt" study it 
docs not determine whether physicians and their 
families are better off with respect to health 
status than other segments of the population who 
may bo presumed to be less knowledge able about 
medical pare but comparable in other respects, 
such as education and socioeconomic position. 

A probability sample of some 500 physi- 
cians in New Jersey was interviewed to find out 
what physicians and hospitals they used. The 
characteristics of (he physicians actually used 
were established primarily on the basis of replies 
to a mail questionnaire to them. I will not go 
into a long series of findings on that study (part 
of which has been published) , but I would like to 
call your attention to just one or two that are per- 
tinent (o (his meeting. 

One finding from the New Jersey physi- 
cians' study has to do with surgery. You may 
he familiar with the position of the American 
Academy of General Practice with respect to 
which physicians are qualified to do surgery. In 
the New Jersey study, no member of the Academy 
of General Practice was used by physicians for 
surgery. In point of fact, no general practitioner 
of any sort was used for surgery for physicians or 
for any member of their families. No member 
of the Academy of General Practice used any other 
member of the Academy of General Practice for 
surgery for himself or family. 

With respect to choice of hospital for major 
elective surgery, physicians tended to leave their 
home state (New Jersey) and go to places they 
were familiar with primarily by reputation rather 
than personal acquaintance, such as university 
teaching hospitals in the largest cities within com- 
muting distance New York, Philadelphia, or 
Boston. For minor conditions and for emergency 
situations, they were more likely to use local com- 
munity hospitals, 

In the course of the interview, the N"fiw 
Jersey physicians were asked whether they 
thought the method of payment of physicians hud 
anything to do with the quality of care and 
whether they preferred for themselves personal 
physicians who were paid on i\ fee-for-service 
basis or on a salary basis. 



With respect to their opinion as to relation- 
ship between method of payment and quality of 
medical care, about 8 out of 10 physicians ex- 
pressed the opinion thai physicians paid by fee- 
for-service were likely to provide better quality 
medical care than physicians who were on salary. 
With respect to their own choice of personal physi- 
cian, however, only 4- out of 10 preferred a fee-for- 
service physician. So much, for the present, for 
the study of New Jersey doctors. 



Nonmedical factors 

Now, with respect to the Puerto Rican 
study, an islandwide household survey of 2,950 
families, I would just like to mention a few find- 
ings on the relation between nomnedical, social- 
group membership factors and patterns of utiliKii- 
J ion of medical care. I refer particularly to socio- 
economic class. "Without defining them precisely 
here, we may consider three broad classes of people 
in Puerto Rico: (lie "poor," the "middle class," and 
the "rich," "For all three classes, the frequency 
of use of physicians in a specified period immedi- 
ately preceding the interview was precisely the 
same 2.8, 2.4, and 2.2 percent. But the pattern 
of use where the physician was seen, for example 
is quite different for the three groups. 

The physician was seen inside his office by 
fi percent of the poor; by 10 percent of the middle, 
class, and by 15 percent, of the rich. Conversely, 
15 percent of the poor visited physicians in public 
clinics or health centers, as did 9 percent of the 
middle class and tt percent, of the rich. (Economic 
status is apparently not routinely checked when 
people present themselves at, public health centers. ) 
Visits to the patient's home by the physician : for 
the poor, 0.8 percent; for the middle class, 1.4 
percent ; and for the rich, B.fi percent. 

There were similar findings with respect to types 
of hospitals where people stayed. Among the 
poor, 22 percent stayed at a private hospital as 
compared with 50 percent of the middle class and 
82 percent of the rich. The poor experienced a lit- 
tle less surgery than the other two classes. 

Consultations with nonmedical personnel 
with respect to illness : 32 percent of the poor con- 
sulted a- spiritualist, as did 21 percent of the middle 
class and 5 percent of the rich. 
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Washington Heights Study 

Now, may we move from Puerto Rico to the 
Washington Heights Health District in New York 
City, a move which some Puerto Ricaus have also 
made. About, 10 percent, of the Washington 
Heights population is Puerto Rican. The Wash- 
ington Heights Health District is to be found at, 
the upper end of Manhattan Island and contains 
over a quarter of a million population. Columbia 
Presbyterian Medical Center aits in the middle of 
this District. 

One of our graduate students, Sherwin 
Goodblatt, took a look at the utilization of the 
various kinds of hospitals by the people in Wash- 
ington Heights who were hospitalized during the 
year prior to interview. He found, in a sample 
survey, that only about one-fourth of the hospital- 
ized persons used the Columbia Presbyterian Med- 
ical Center, reputed to be one of the best hospitals 
in the Cily ; one-fourth used other hospitals in the 
District; and about half of the population went 
outside the Distinct. In other words, it wns clear 
that many people living in the Washington 
Heights area an area thai happens to have a 
world-renowned hospital went elseu here for 
their h capitalisation. 

Goodblatt also looked at the, relationship be- 
tween a person's religion and the hospital he used 
and found that government hospitals, primarily 
the municipal hospitals, were used more by Prot- 
estants than by Catholics or Jews. Thirty-nine 
percent of the hospitalized Protestants, 15 percent 
of the hospitalized Catholics, and 11 percent of the 
^capitalized Jews used municipal hospitals. 

The Jews in Washington Heights were more 

ikely lhan other religious groups to patronize 

proprietary hospitals: here wo have a figure of 13 

percent for the Jews, 4 percent for the Catholics, 

ad 2 percent for the Protestants. 

Now, in Washington J-Teights it so happens 

at many of the Proteshmts are Negroes, and that 

ilf of them use government hospitals which are 

^credited. In contrast, only 34 percent of the 

,'hites used accredited hospitals. 

Well, this seems like a disparate set of find- 
ings from Ihree different studies, but I wonder if 
there isn't some patterning to be seen here. In each 
of the areas New Jersey, Puerto Rico, and Wash- 
ington Heights it is clear there are very powerful 
uonmedical social forces, i.e., indexed by member- 



ship in social groups, which may have to be taken 
account of somehow in whatever planning is done. 
Attempting to shore up situations of this sort with 
seemingly rational schemes, in the midst of such 
rapidly flowing social forces, presents some really 
tough problems. 

Finally, and simply, to repeat what I said 
at the outset, none of these studies that we have 
heard about so far here, including the ones I have 
talked about,, have shown a relationship between 
patterns of medical care and the health status and 
social functioning of the population. None ad- 
dresses itself directly to the "so-what" question: 
What do different ways of delivering medical and 
hospital care mean in terms of the ability of people 
Lo live, work, play, and bo healthy? It, remains a 
challenge to try to develop research along such 
lines. 



Family Medical Care Survey 

DR. JOSEPHINE J. WILLIAMS : 

The study which I am going to tell you 
about is called "Family Medical Care Under Three 
Types of Health Insurance." The report was re- 
cently published by the Foundation on Employee 
Health, Medical Care, and Welfare,* which, as Dr. 
Trussell indicated, is a joint effort by management 
and labor. The International Association of Ma- 
chinists is the union sponsor of the Foundation; 
(he management sponsor is U.S. Industries, Inc. 

The study was done at the School of Public 
Health and Administrative Medicine, Columbia 
University, with the cooperation of the Nafional 
Opinion Research Center of the University of 
Chicago. We wanted to compare the utilization of 
medical care and the cost of medical care, under 
three important types of health insurance. We 
wanted to find out whether families used the same 
amount and kind of medical care under the three 
plans and how their out-of-pocket expenditure 
compared. 

The survey dealt, with three particular 
plans, each of which was considered a good one of 
its kind. The first, was New Jersey Blue Cross- 
Blue Shield which, as you know, is basically an in- 
hospital service-benefit plan. The second was tho 



*477 Madison Avenue, New York 22, N.Y. 



General Electric major medical plan, a very com- 
prehensive plan. The deductible is either $25 or 
$50 per person per year. The coverage is unusu- 
ally broad. For instance, psychiatric care is cov- 
ered. The third was the Kaiser Foundation 
Health Plan, with which yon are all familiar. It 
is a prepaid group practice plan, serving a number 
of communities on the Wesl Coast. Our survey of 
the Kaiser Plan was limited to the San Frnncisco 
Bay area. 

I shall now fake a few moments to sketch 
the survey design. For each plan, we started with 
a population ol' men who met three criteria they 
lived in specified locations; they belongec] to cer- 
tain unions; and each man had had continuous 
coverage throughout the year 1958, bolh for him- 
self and for any eligible dependents. The samples 
for New Jersey Blue Cross-Blue Shield and (he 
General Electric Plan were both drawn from mem- 
bers of the Intel-national Association of Ma- 
chinists, but we were not, able to use the same union 
for the Kaiser Plan, Our sample of Kaiser Plan 
subscribers was drawn from a population of all the 
blue-collar unions in the San Francisco Bay area 
which had secured Kaiser Plan coverage through 
negotiations. This population included large 
groups of longshoremen and warohoxisemen ; 
I'ostaurant, and tavern workers were another large 
group. In all, some 14 unions were represented. 

A probability sample of approximately 800 
men was drawn for each plan. The samples wore 
stratified by the age of the man; so that a quarter 
of the men were under ago 35, another quarter wore 
35 to 4-5 years, and so forth. We began with a 
household survey. (I shall mention our other 
sources of data in a moment.) With the help of 
the National Opinion Research Center, a response 
rate of some 93 percent was secured for the two 
samples drawn from our friends, the Machinists; 
the response rate Jor the Kaiser Plan sample was 
88 percent. Thus the samples actually obtained 
ran around 700 to 750 families for each plan, or 
something over 2,000 individuals per plan. What 
that, size means depends, of course, on whether yoii 
arc thinking in terms of the cost of research which 
involves personal interviews in men's homos or in 
terms of the sampling error in, say, hospital ad- 
mission rates. 

It turned out that the samples were well- 
matched on both age and sex for all family mem- 



bers, although the stratification was only for the 
men 'sago. 

Turning now to the sources of data, I have 
already mentioned the survey interviews. NOUC 
interviewers inquired in detail about the family's 
utilization of medical care in 1958 and the cost of 
their medical care, among other things. When the 
families reported that some member had been in 
a hospital, we wrote to the hospital to confirm the 
date of admission, the length of stay, and the 
hospital's charges. These hospital records wore 
the second main source of data. The third was the 
carriers' records. New Jersey Blue Cross-Blue 
Shield checked their records for every hospitaliza- 
tion that had been reported in the family inter- 
view. The Metropolitan Life Insurance Com- 
pany, which is the carrier for the General Electric 
Plan, did an even more thorough check. They 
did not limit their validation to claims that had 
been reported by interview. They searched their 
files for claims by every person in the- sample. 
This "two-way" check picked up half a dozen hos- 
pitaliKations not mentioned in the interviews. 

In summary, the strengths of the survey 
design were ; first, that it, covered types of medical 
care and expenditures which can only be obtained 
by personal interviews with subscribers. For in- 
stance^ we were able to find oitt the extent to which 
members of the Kaiser Plan went outside the plan 
lor their medical care. Second, many of the data 
were validated. Third, the age and sex distribu- 
tions of all three samples were very similar. 

Two limitations of the survey design should 
also bo borne in mind, particularly with reference 
to the findings on hospital utilization, which are 
the only ones I shall report today. First, samples 
of 750 families per plan, or about 2,000 family 
members per plan are not largo for studies of 
admission rates or length of stay. This means 
that we have to allow for a large sampling error 
in such variables. Second, we decided to study 
intrinsically important plans, even though they 
operated in different parts of the country. This 
involved a very difficult methodological problem. 
Regional differences are confounded in our results 
with the differences between types of insurance. 
We did what we could to circumvent this difficulty, 
but I shall not attempt to discuss these techni- 
calities today. 

Our main finding on hospital utilization is 
easy to state: Considering the sampling variabil- 
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ity, wo found no evidence of any difference in hos- 
pital utilization between the throe plans thai, is, 
the rates were essentially the same for our three 
matched samples. 

Our basic unit is the hospital stay, which is 
not quite the same ns an admission. Stays include 
tho 1058 part of a hospitalization which began 
in 19B7 and continued in 1958, as well as the 1958 
part of admissions which extended into 1959. This 
choice of unit does not make any difference in our 
main conclusion. We were interested in stays in 
short-term hospitals, excluding obstetrical stays 
and also stays under Workmen's Compensation or 
at public expense. Thus, our unit, was the non- 
obstetrical stay in a shorl-term hospital, nsidc 
from free care. 

The number of such stays per 100 persons 
was 7.6 for the New Jersey Blue Cross-Blue Shield 
sample, 7.1 for the General Elect rio sample, find 
7.9 for the Kaiser Plan sample. I emphasize 
again that, these differences are not- statistically 
significant. 

The number o.f days of care per 100 persons 
(again I am reporting non-obstetrical cases in 
short-term hospitals, excluding free care), was 
practically identical for the three plans 58 days 
per 100 persons for the New Jersey Blue Cross- 
^lue Shield, 61 for each of the other samples, 
hus WG failed to establish any difference in hospi- 
,1 utilization, although some other studies have 
mud lower admission rates under the Health 
nsurance Plan of Greater New York, which is a 
prepaid group practice plan somewhat similar 
to the Kaiser Plan, We did not prove that the 
rates for the three plans studied were identical; 
rather, we failed to find the anticipated difference. 
Let me mention briefly two other findings 
which may interest you. First, tho admission 
uates for children did turn out to bo lower under 
tho Kaiser Plan than under either of the other 
plans. This seems to bo explained by a lower 
admission rate for tonsillectomies. This finding 
is based on relatively small numbers, approxi- 
mately 900 children per plan, but it is interesting 
because it agrees with the studies of the Health 
Insurance Plan of Greater New York. 

Finally, members of the Kaiser Plan ob- 
tained about 92 percent of their hospital care 
(aside from free cnro) through tlieir plan, and 
went outside the Kaiser Plan for the other 8 per- 
cent. 



DISCUSSION 

THE CHAIRMAN: 
Are there questions? 

DR. PAYNE; 

I wonder if some of the criticism aimed at 
the report by Dr. Trussell regarding the Team- 
sters in New York might not have been avoided 
if individual judgment by a physician, regardless 
of competence, had been replaced by a group judg- 
ment of physicians who published their criteria 
for the decision as to whether the admission was 
appropriate or not, the length of stay was ap- 
propriate or not, or the quality of the care was 
adequate. Quality of care, especially, is a very 
touchy subject and needs to be established, not by 
one physician but by groups of physicians. 

I also have a question. Your assumption 
is that the patients who are admitted on Friday 
stay longer of necessity because they cannot re- 
ceive laboratory tests until the following Monday. 
Is this an assumption or is it backed up by fact? 

DR. TRUSSELL: 

Well, to answer your first question, we 
are just as interested in group decisions as you 
are. The conditions selected for auditing were 
chosen because there are fairly available criteria 
in the field. If you look at our report, you will 
find that we tried to mention only the fairly larger 
numbers of patients and that we wore giving the 
other data as illustrative. This report was writ- 
ten for a lay board of trustees and is not a techni- 
cal document. We are into the technical work 
now where we are going (o have photostatic copies 
of hospital records reviewed by surveyors in dif- 
ferent parts of the State independently. I don't 
think these particular studies, frankly, would have 
been grossly different in their conclusions if we 
had a group of surgeons looking at these records. 
We worked from the photostatic copies of the 
hospital record. We do not send people medical 
students or lay people or nurses or what have 
y ou out to the hospital to abstract the record. 
We get a written consent from the patient. There 
is a reliable firm in New York City that works with 
the greater New York Hospital Association, which 
picks up the records, takes them to the central 
office, photostats them, and returns them to the 
hospital within 24 hours. Therefore, the physi- 



cian doing the evaluation has the original medical 
record in toto. One of these ran over GOO pages 
and we did the whole 600 pages. Wo are afraid 
that abstracting can lose some bits of information, 
such as nurses' notes, which are very important. 

"We agree that for research purposes now, 
we would, like to have group judgments, but we 
want to study the group judgment. Further, we 
feel that what we have been doing is an experi- 
mental approach, and there is no question that it 
requires refinement. 

As far as medical reaction lo this report is 
concerned, I don't think it would have been any 
different no matter under what, auspices or what 
circumstances it was released. After all, these 
kinds of reports have been coming out for many 
years. The American College of Surgery reports, 
the fairly recent article in the AMA Journal 
about unnecessary gynecological surgery are two, 
for example. This just happened to got a very 
high component of publicity, and what made the 
local physician irritated was my statement that 
some of the problems of medical care in New 
York State were worse in New York City and 
that the New York physicians were not doing 
anything about it. They retaliated by saying 
that they do have grievence commUU'es to which 
people can come with their problems. 

In connection with your other comment, 
there is no question but that we will get a partial 
shut-down on weekends, particularly in large hos- 
pitals. Yon can only get emergency surgery over 



the weekend. You can only get emergency labora- 
tory and X-ray facilities on Salnrday afternoons 
through Sunday night. In our Blue Cross 
studies, we ciune upon one poster on the bulletin 
board of a doctor's staff room in one voluntary 
hospital that said, "Doctors, if you can raise the 
occupancy rate of this hospital 8 percent, we will 
break even. Please check your lists." 

T happen lo know of at least one hospital 
in New York City where, if a bed opens up on 
"Friday for a patient who is scheduled to come in 
on Monday, the doctor is called up and told to 
get his patient into that bed. There is just no 
question about it;, voluntary hospitals are con- 
stantly in need of more money and so they main- 
tain as high an occupancy as they can. As 
Commissioner of Hospitals I occasionally get 
letters from a hospital saying, in effect, "Dear 
Commissioner, our census is very low, would you 
mind filling us up?" 

"Wo have had, at our Columbia Presbyterian 
Medical Center, a committee studying the 7-day 
week, and they came to the conclusion that a 7-day 
work week was impractical for that center be- 
cause, among other tilings, there would probably 
not bo enough personnel to operate on that sched- 
ule, However, they did get considerable improve- 
ment in availability of laboratory services and 
X-ray on weekends and scheduling of operations 
on Saturday morning. These are only illustra- 
tions of a few problems which research and ad- 
ministration working together can help resolve. 
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WEDNESDAY MORNING SESSION 
January 23, 1963 



The meeting was called to order at 9:00 
a.m., Mr. Bugbee presiding. 

THE CHAIRMAN: 

I am going to introduce tho panel and ask 
[hem, as listed, to make such comments as they 
think are indicated. Then I hope there will be 
questions from the floor and among the panelists. 

You have tho stated objective ol the panel. 
I think it is not an easy assignment for these five 
men, nor did I gather that they thought so. On 
the other hand, they will come to grips with prob- 
lems and methods for research in this area, study 
methods, as they are able, 

Most of you know the group and, again, I 
won't go into any extensive introductions. Dr. 
Lester Breslow, whom you all know, carried on a 
great deal of research in the Department of Health 
at Berkeley. He is responsible Tor the test work 
on the health survey in California, that preceded 
our national study. Also, every time I see Lester, 
he has various other interesting research projects 
which go beyond (he bureau of chronic diseases in 
their broad interest. 

Jacob Feldman has been the keystone of the 
National Opinion Research Center for years. It 
has been a pleasure for the staff of HIF to work 



with that agency and with Jack, a sociologist, who 
is indeed a very experienced individual in survey 
research and research generally in the health field. 

Victor Fuchs is an economist. For some 
time he was working with the Ford Foundation 
reviewing the health field from the standpoint of 
economics. He is presently program consultant 
in economic development and administration for 
the Foundation and is a member of the staff of 
the National Bureau of Economic Research. He 
has been on the faculty of both Columbia and 
New York Universities. 

Don Rieclel was on the platform yesterday. 
He has just taken the job as Director of Research 
and Planning for Blue Cross, coming from the 
faculty and research group in the Graduate School 
of Business at Michigan and the program on hos- 
pital administration there. 

John Thompson, director of the program at 
Yale, has been doing research within the hospital 
at Ne\v Haven for a number of years. He is an 
experienced individual in both research and hospi- 
tal administration. 

TVith that very brief introduction, Lester, 
do you want to start off with such comments 
as you care to make ? 



THE NEED FOR. A MULTIDISCIPLINED APPROACH 



DR BRESLOW: 

I would like to spend my few moments here 
on tho problem of the validity criterion. There 
was some discussion of it yesterday, and it seems 
to be worth more attention. Throe categories of 
validity criterion are being used, or at least talked 
ibout, in hospital utilization studies. 



One. might be called the "normative" cri- 
teria (hat is, determining the usual practice : how 
many days patients stay in for delivery, how 
many days for an appendectomy, etc. This type 
of criterion does have some uses. We are using 
it right now in the development of a hospital serv- 
ice index for county hospitals in California, where 
we have been asked to take a look at standards and 



quality of care. We are ascertaining the extent 
to which various county hospitals have particular 
services, such as a pharmacy or pathologic service, 
and we are giving an arbitrary weight to each of 
these services. Out of more than 100 such items 
we have built an index with a maximum total score 
of 1,000 points. The approach is that of deter- 
mining usual practice. 

The second criterion received most of the 
attention yesterday and usually does because it is 
regarded as a better criterion. It is based on ex- 
perl opinion or peer judgment. Typically, a re- 
view of actual procedures is conducted by some 
expert person or group to determine whether they 
were -justified or were properly clone. For exam- 
ple, an expert group of physicians may look over 
the records of practice and determine if things 
were properly done, if they camo up to a standard 
of expertness. Work along this line is underway 
in several places at the present time, well exempli- 
fied by the studies of Tniasel and others of the 
Columbia School of Public Health and Medical 
Administration. 

Both of the above types of criteria are use- 
ful. However, it seems to me that we ought to get 
down to the third, that is the "so-what" criterion, 
"When Dr. McNinch was making the introductory 
remarks yesterday, you will recall, he compared 
what Americans spent for automobiles and some 
other things with what they spent, for medical 
services. A cynic would have responded, "Yes, 
but automobiles will get you somewhere where 
will hospitals get you?" That is really the ques- 
tion. Therefore I think that we ought to look at 
this ultimate or "so-what" criterion. 

.Tuck Klinson yesterday indicated that this 
type of criterion had not been used. He expressed 
some doubt as to whether it could be used, I would 
like to take issue with that point of view. It seems 
to me that this criterion, which may be called the 
criterion of effectiveness or the criterion of end- 
results, can be and is already used in a very limited 
and tentative kind of way, I would like to give 
you two brief examples, 

One is in the tumor registry system in Cali- 
fornia, for example, where hospitals report not 
only the beginning data about a case treated for 
cancer, but the long-term followup data. We have 
just completed an analysis of 110,000 cases extend- 
ing back over a period of about 30 years to find 
out how long patients with various personal char- 
acteristics, various types of cancers, and various 



kinds of treatments survived. One analysis was a 
comparison of the experience of patients who are 
treated in comity hospitals (our public hospitals 
corresponding to the municipal hospitals in the 
East) with experience of patients in voluntary 
hospitals. Patients in the voluntary hospitals did 
much better, measured by the criterion of survival 
which is the accepted index of effectiveness oC care 
for cancer patients. Patients treated in private 
hospitals survive longer than do Ilia patients 
treated in the public hospitals. 

Many of you will immediately think of sev- 
eral possible explanations for this finding: differ- 
ent age of patients, different sites of rnnccr, and 
different degrees of advancement of the cancer. 

We took into account as care Cully as we 
could all these factors, by examining age-specific 
groups, several individual sites, and only localized 
cases for the particular sites. 

Still we found (hat the county hospital 
patients with localized cancer, at the end of 5 
years, have substantially lower survival than do 
patients in the private hospital, 38 percent as com- 
pared to ISO percent. This makes it difficult to es- 
cape the idea that the finding has something to do 
with quality of hospital service. It may be that 
the patients do not "accept" the treatment or do 
not follow through with it. There arc u lot of 
possible explanations. However, it seems to ma 
that survival of cancer patients illustrates the kind 
of criterion that we ought lo be utilizing more and 
more in studies of hospital work. What wo really 
want to know is what is being accomplished, the 
end-results. 

Just one other brief example. The ICaisor 
Foundation Health Plan is now carying out a 
study of the effectiveness of a multiphasio health 
checkup, a battery of laboratory and physiologic 
tests combined with medical followup. It has been 
alleged that if people have this type oC preventive 
medical service they will live longar, There is 
some evidence in this direction, but it is not very 
convincing. The Kaiser people arc making a real 
study of this by selecting a sample of their sub- 
scribers to receive the test, They are making every 
effort to get them in for it. They will keep as 
controls a corresponding sample of their subscriber 
population. They will observe both groups over 
a period of several years to determine if there 
really is any difference in mortality, morbidity, 
and physiologic measurement following applica- 
tion of a mul tiph using screening program. 
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These are the kinds of criteria criteria of 
the effectiveness of the care which, it seems to me, 
we ought to bo introducing in our hospital utiliza- 
tion studies. 



The Role of Economics 

MR. VICTOR FUCHS: 

George Bugbee has given me the "easy" as- 
signment of telling you what economics can con- 
tribute to research on hospital utilization. I am 
afraid that lo an audience consisting mostly of 
nonoconomists I will only he able to open up the 
subject in (he time available, and not answer all 
your questions. 

In one sentence you can do this for eco- 
nomics. In fact, it has been done. You can sum- 
marize all of the lessons of economics in a six-word 
sentence to maximize-equalize at the margin. 
The economists in the audience know what I mean. 
The rest of you probably do not, and it would take 
considerable time to explain what is meant by max- 
hnixaHon, equalization, what it is that you equal- 
ize, and what is meant by the margin. 

I do think economics has something to offer 
to the study of health and hospital problems, I 
think it has two things to offer. 

First, economists have a set of concepts, 
tools of analysis, which are relevant to many hos- 
pital problems. The economists can suggest some 
f the questions that ought to be asked. They 
unnot give the answers. The answers have to 
ome out of the health field itself. The economist 
can, however, help to frame the analysis and point 
i(- in the direction where the answers will be rele- 
vant to the problems confronting people in the 
health field. 

I -will give you a few examples of some of 
those concepts. For instance, in the area of costs, 
economists make various kinds of distinctions. 
They distinguish between fixed cost and variable 
cost. This can be very important in certain prob- 
lems of analysis in hospital utilization. 

They distinguish between average and mar- 
ginal coat. Again this could be very important. 
Marginal cost is the incremental cost which is sus- 
tained in providing an additional unit of some 
particular type of service. 



To illustrate there are various costs at- 
tnched to providing private, semi- private, and 
ward accommodations. Frequently hospitals will 
make an average cost calculation of the various 
types of accommodations and then may or may not 
use these average costs to set prices. Economists 
would probably question this procedure. They 
would ask what is the incremental cost of pro- 
viding semi-private as opposed to ward accom- 
modation? What is the incremental cost of pro- 
viding private as opposed to semi-private accom- 
modations? Then they might, suggest a different 
type of pricing procedure. 

Another distinction made is between his- 
torical and alternative or opportunity costs. The 
economist is not content to say, "what did this 
cost you?" in the sense of how much money did 
you pay out or what are you carrying it on the 
books at. You may be carrying it on the books at 
zero. It may have been a gift to the hospital. 
However, that doesn't mean you can use it as if it 
were a costless resource. Instead, the economist 
would suggest that you look at the alternative 
use of this resource what other opportunities are 
available to you what costs are foregone. 

For example, in calculating the cost of 
medical education, economists would suggest that 
it is not enough to simply calculate the full cost 
of training a doctor in the sense of providing him 
with medical school and teaching and other facili- 
ties. They would say there are foregone costs in 
the sense that, if he were not studying medicine, he 
could be producing actively in society at that par- 
ticular point in time. These foregone costs should 
be included in a proper calculation of cost of train- 
ing a physician. 

On the demand side, an important concept 
is the demand schedule the fact that the demand 
for any good cannot be thought of in terms of a 
single point on a two-dimensional chart but in- 
stead, must be thought of in terms of a relationship 
between the price of whatever it is that is being 
offered and the quantity that would be demanded 
at various prices. 

Along with this concept comes the one of 
elasticity that is, how responsive is the quantity 
demanded to changes in the price and, similarly, 
how responsive would be the quantity supplied to 
changes in price? We- hear a great deal of talk 
about a nursing shortage. Again, this is a word 
(hat the economist would use in quotation marks 
because the shortage concept is not a very rigorous 



one from the point of view oC economic analysis, 
Nevertheless, there is a presumption hem that if 
higher wages were offered to nurses, more people 
would ho attracted to the nursing; profession. 
However, how much higher, and how large a re- 
sponse would there be on the supply side if the 
wages were increased ? This is where the elasticity 
concept comes in. 

Another concept is the notion of production 
function the notion that you produce a service 
by a combination of various factors and that this 
combination is usually not a fixed one that is, you 
can vary the proportions of the. various factors. 
You can have more doctors and fewer nurses; more 
nurses and fewer doctors, or other combinations, 
And there is, given the prices that are prevailing 
for these various kinds of resources at a given 
time, a better combination and a poorer combina- 
tion from the economic point of view, 

Now, in addition to concepts and tools of 
analysis, I think economists can also bring to the 
hospital field experience gained in other industries, 
I know that Rome of you will immediately have 
reactions to the effect, "Well, hospitals are dif- 
ferent. they are unlike every other industry." 
This is a normal reaction. I haves never spoken 
to any industry group anywhere that did not have 
the same reaction "My industry is unique" and, 
to a certain extent, you are correct. However, my 
experience has been that, to a certain extent, if you 
believe that, you are wrong. Certain things have 
been learned in other industries which would have 
application to hospital problems. 

Does the hospital have labor problems? 
Economists have been dealing with labor problems 
for years. 

Does the hospital have problems of pricing? 
"Economists have been dealing with pricing prob- 
lems for years, and some of thafc experience not 
all of it will bo applicable and helpful to hos- 
pitals in dealing with (heir own problems. 

I would like to conclude with a word of cau- 
tion, one that is not necessary, really, in this group 
but would be if I were speaking to a group of econ- 
omists. Simply this I very sincerely believe 
that, although economists have something to con- 
tribute to health problems and hospital problems, 
they must never become in any sense the masters 
or the controlling factor in the approach to these 
problems. The economists will need the guidance 
and cooperation of people who have training in 
the health field. He must always, in applying 



economic analysis, take into account that he is 
dealing with a vital type of professional service 
and be guided hy the experience of doctors, nurses, 
hospital administrators, and other professional 
people. 



The Survey as a Research Tool 

ME.J..T.FELDMAN: 

Even though this panel is described in the 
program as dealing with research methods, I find 
my position on it rather singular. It turns out 
that the other panel members wore invited to par- 
ticipate as representatives of substantive disci- 
plines that is, they represent approaches to the 
interpretation of data. I am the only one who 
is supposed to represent a particular technique of 
duta collection. 

Sample surveys have been and no doubt will 
continue to be employed to provide grist for the 
respective mills of each of the substantive disci- 
plines represented hero, For many of the prob- 
lems being discussed, there are obviously data col- 
lection 1 echniques more appropriate than the sam- 
ple survey, Novoretheless, I shall take it as my 
proper function to perform a partisan role. I shall 
try to point out some of the ways in which surveys 
might serve as useful adjuncts to other research 
(echniques. 

For instance, while record studies are fre- 
quently a more economic and reliable menus of 
establishing relationships among certain variables, 
(hey givo us very little idea of what processes are 
operating to produce the relationship. Paul Den- 
sen, in his paper yesterday, gave an example of 
how a survey can at least help discount an expla- 
nation of a- relationship, even in instances where it 
does not itself provide an acceptable one. The 
record study had shown that the Dress Joint 
Board members who had chosen to be covered by 
HIP hud lower hospital utilization rates than 
those who had chosen GfflZ This is certainly a 
provocative finding but then the question immedi- 
ately arises as to whether there was a self -selection 
process in operation. Are people who join HIP 
healthier than, those joining GHI? Do the HIP 
members have different attitudes toward hospital!- 
zation and toward health in general? 
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Now, the HIP survey that had been con- 
ducted about the same lime as the record study 
indicated that self-selection was probably not a 
serious problem. The two groups seemed to differ 
primarily with respect to their shop stewards' 
preferences rather than with respect to health at- 
titudes or level of illness. Once it was established 
that the observed differences in utilization rates 
were not merely the spurious consequence of self- 
selection, the investigators were able to turn, in 
their search for an explanation, to factors like the 
mode of physician compensation, access to hos- 
pitals, the availability of diagnostic facilities 
within the group, etc. 

Here is another example of how a survey 
might, help us understand the processes underlying 
an observed relationship. We know from a num- 
ber of studies that in areas with high bed-to- 
population ratios, there is a much higher level of 
hospital utilization than in areas with low bed-to- 
populatiou ratios. ITere again, the observed re- 
lationship is obviously a valid one but we do not 
have a precise picture of the mechanisms which 
bring it into being. Thus, it might very well be 
worth while to conduct surveys in areas of both 
types and perhaps, in addition, in areas where a 
change in the bed-to-population ratio appears im- 
minent. How does an exogenous factor like the 
supply of beds get translated into adaptive actions 
on the part of physicians and patients? For in- 
stance, if one could find a situation where a rural 
hospital is about to close down, it would be valu- 
able to determine exactly how physicians adjust 
to a decrease in the number of available beds. I 
don't think that these surveys would come up with 
any surprising new findings they would simply 
give us a better understanding of the mechanisms 
through which the bed supply influences behavior. 
We might learn more about the alternatives to 
hospitalization by examining what people were 
doing prior to an expansion of hospital facilities 
and how they come to use the additional beds when 
they become available. 

Yet another example of how surveys might 
further our understanding of underlying proc- 
esses derives from the Peterson-Barsamian study 
discussed yesterday. Conceivably, the surgeons 
in quest ion could have been asked why they in 
fact did not follow certain procedures, I don't 
know what would have come of this. The sur- 



geons would obviously have been highly defensive. 
However, the investigators still might have ar- 
rived at ,a somewhat better understanding of what 
was going on. What were the mental processes 
accompanying the omission of the certain desir- 
able procedures? To what extent was it a matter 
of not knowing any better? What situational 
factors acted as harriers to optimum perform- 
ance? Again, the survey would be simply an ad- 
junct, bill it would give you some idea of what 
was producing the phenomena that were observed. 

Another type of situation might be a study 
of some areas where there are very high occupancy 
rates, to determine what the hospital administra- 
tors and medical staff are doing that keeps the 
heels full. 

The one other use of surveys which I shall 
mention is in the area of program evaluation. 
Surveys can perform an extremely important 
function by determining what is going on in ex- 
perimental situations. In other words, surveys 
can sometimes tell us how people reacted to the 
stimulus that was introduced. For instance, let's 
say that a program to control hospital utilization 
is introduced into certain areas. There are review 
committees at the hospitals and there is a public 
relations campaign among physicians attempting 
to convince them that there are alternatives avail- 
able that hospitals should he used somewhat 
more sparingly than at present. Surveys of both 
physicians and patients could be quite useful. We 
could determine what new alternatives were em- 
ployed in situations which would have previously 
resulted in liospitalixation. Do patients become 
accustomed to high levels of utilization? How do 
they feel about having things more frequently done 
in the doctor's office? Do patients become aware 
of an elevation in the threshold of hospital admis- 
sion and what is their reaction to it? How do 
the physicians r^act to outside "interference?" 
Such considerations might help explain why some 
programs don't work. I might cite as an example 
of this type of function for surveys the study of 
hospital regionali nation by McNerney and Biedel. 

I should liko to conclude by saying that 
while I really do not see survey techniques as a 
panacea for hospital problems they can be quite 
useful adjuncts to experimental programs, to rec- 
ord studies, to medical audits, and to various other 
types of research procedures. 



Sociological Aspects of Hospital Research 

DR.D. C. RIKDEL: 

Just before lunch yesterday, Jack and I were 
wondering who was going fo play the role of 
sociologist. We finally decided that I was. 

In commenting on methods which might be 
useful in research on hospital use, T would like to 
suggest one of the principal methods used by any 
discipline: the construction of a frame of reference 
for denning the components of si problem. Two 
problem areas were mentioned repeatedly yester- 
day, in which I believe the techniques of modern 
social research could produce some meaningful 
data. 

The first problem area concerns evaluating 
the appropriateness of hospital use. A number 
of studies have focused on the same issue in a vari- 
ety of ways and have come up with widely diver- 
gent estimates of faulty utilization. Certainly 
studies should be conducted to compare the results 
of the alternative methods, preferably on the same 
patient or patient records. 

For example, there is n need for comparing 
ihe results of a review by individual physicians 
versus panels of physicians, using criteria con- 
structed before the evaluation, as compared with 
not using any formal criteria. But it doesn't take 
a social scientist to make these comparisons. 
Where his skills would bo useful would be hi in- 
vestigating the judgmental processes involved in 
arriving at a decision as to whether a patient re- 
ceived the care consistent with his condition. This 
point was mentioned by Dr. Jaco yesterday. 

The group judgment process and its rela- 
tionship to individual judgments is an interesting 
phenomenon in its own right and, certainly, 
worthy of study in connection with studies of hos- 
pital use. We could profitably borrow from the 
findings and armamentarium of tools of social- 
psychological research to shed light on the con- 
sequences of the different approaches to evaluating 
care. We know, for example, that the type and 
amount of leadership and authority exercised in 
group evaluation can radically affect (he collective 
judgment. At both extremes, it could result in 
collective error or rally differing viewpoints to 
arrive at a more accurate estimate. 



We experienced this leadership ctFecl in 
our Michigan study, where one of the panel chair- 
men was an eminent person in his specialty and, 
although there were panel members who had dif- 
ferent viewpoints, (ho leadership he exercised re- 
sulted in more stringent criteria for this particu- 
lar diagnosis. Other panels were a little more 
permissive and provided a range of acceptable use 
to encompass that which is actually practiced. 
This difference in approach and the difference in 
composition of panels probably accounted for an 
unknown portion of the difference in estimates of 
inappropriate use by diagnosis, according (o our 
data. 

Now, we also know (hut group discussion 
leads, in many cases, to a modification of opinion, 
We were fortunate, a few months ago, to have 
Drs. Peterson and Barsamian in Ann Avbor to 
discuss possibilities of using the approach that 
they described yesterday on the data wo collected 
in Michigan. During the visit we looked at a 
number of actual cnse abstracts to determine 
whether they were amenable to (hat approach. 
The discussion rapidly developed into a judgmen- 
tal process with reference to (he appropriateness 
of the admission. 

T remember one case in particular, an ap- 
pendicitis case, involving a young girl , They both 
agreed that this was certainly an unnecessary ad- 
mission on the basis of the medical record alone. 
It was a case hospitalized in Dr. Payne's hospital 
by a colleague of his ; when ho pointed out tlie qual- 
ifications of this person they modified their view- 
point. 

I cite this not to imply that the original 
decision or opinion was correct or incorrect or the 
revised opinion was correct or incorrect, but mere- 
ly to illustrate that hero is a vital area that needs 
some clarification. This is not only important for 
the interpretation of the differences in results from 
the various approaches, hut also for- the develop- 
ment of so-called optimum evaluation methods, 
ancl certainly, for the composition -of utilisation 
and audit committees, 

One part of this problem area involves the 
question "from what sources do physicians con- 
struct the components of their own criteria, and 
whftt is the relative importance of each source?'' 
For example, how important is the training in 
medical schools versus practical experience, versus 
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imitation of esteemed or influential colleagues? 
In the Michigan study, tlie largest single factor 
mentioned as explaining departure from the cri- 
teria was "physician's usual practice in such cases." 
Tom Fitzpatrick reported yesterday on the change 
in practice on the part of general practitioners 
with increasing years in practice, although special- 
ists remained fairly similar over the years. 

The second major area which concerns me 
a great deal was alluded to several times yester- 
day. This involves two basic approaches to 
measuring quality of care, the technique of ad- 
ministering care (e.g., such things as proper 
surgical technique, adequate physical examination, 
good history -taking) versus evaluating the end- 
result of the treatment process. Dr. Elirison men- 
tioned that no one has really come up with a 
satisfactory method for this latter type of evalu- 
ation. This is true in most instances, although as 
Dr. Breslow pointed out, some specific procedures 
administered for some illnesses would he ame- 
nable to evaluation. 

An important point to consider which, until 
recently, I thought was unnecessary or gratuitous 
to mention, is that in most situations there is an 
intervening variable involved the patient. It is 
somewhat dangerous to simply correlate variations 
in specifics of administration of care with the de- 
gree of recovery. Obviously, the importance of 
His intervening variable fluctuates considerably 
wording to the situation. For many illnesses, 
xerapeutic advice assumes major importance iu 
lie treatment process. To measure the adequacy 
of this advice is one thing, but to comment on 
whether this advice, per se, had an effect on the 
well-being of the patient, without determining 
how the patient interpreted and followed through 
on the advice, is something else. 

Very few studies have been clone to deter- 
mine the disparity between actual and perceived 
therapeutic advice, or on the factors influencing 
compliance with the advice. It may very well be 
that, in terms of wastage of our social resources, 
this area is just as important as studies of overuse 
of facilities. Time lost from work unnecessarily 
by recurrence of illness, and even death, could re- 
sult from misinterpretation or deliberate noncom- 
pliance with the therapeutic advice. 

I believe social scientists could contribute a 
'^it deal in this area. 



Effect of Utilization Patterns on Bed Require- 
ments 

MR. JOHN THOMPSON : 

What I am concerned about through all 
these discussions is the effect of various utilization 
patterns on bed requirements. I think this rela- 
tionship is a basic determinant of hospital 
economics. 

For example, somebody spoke about the 
fact that the average length of stay of maternity 
patients on the West Coast is considerably lower 
than it is in my part of the country, New England. 
Does this mean we need half the number of ma- 
ternity beds per unit of population in California, 
or doesn't il mean exactly that? 

In order to determine these kinds of rela- 
tionships, we have beem trying to develop at Yale 
(through U.S. Public Health Service grants) 
some simulation programs for various hospital 
subsystems. In other words, we are interested in 
attempting to duplicate certain activities of certain 
hospital subsystems on a computer. 

We have started with one everybody seems 
to skirt in this discussion that is, with the ma- 
ternity service and we did this deliberately, be- 
cause there are not too many interfering factors. 
A woman is going to have a baby and, at the 
present time, there is no question of whether she 
should or should not bo hospitalised for this event, 

The only questionable hospitalization which 
can occur on a maternity service is for so-called 
"false labor." Until obstetricians can differenti- 
ate over a telephone whether labor is true or false, 
the only decision in most cases is to admit the 
patient and wait for developments. This practice 
does not interfere wilh the ability to simulate the 
maternity serviceit is merely another subroutine 
in the program. 

In certain hospitals studied, there are a 
great many so-called elective inductions. Does the 
factor ojf elective inductions make for more eco- 
nomic use of beds, or doesn't it ? 

We have isolated one basic factthat one 
determinant of the percentage of occupancy, at 
least theoretically, seems to be the size of the 
obstetrical service. When we do production runs 
on the simulation program we find that the bed 
utilization flattens out at 4,000 births a year. Be- 
low 4,000, utilization starts to change in that more 
beds are required per 100 patients per year to pro- 



vide the same level of service. Below 1,800 beds 
a year, the number of required heels per patient 
increases even more. 



Computer Simulation, a Research Tool 

We obtained these values through the 
methodology of computer simulation; then wo 
chocked (hem with actual operating data in Con- 
nect i cut mid found (hat (he theory seemed to have 
validity. For example, (here are 33 hospitals in 
Connecticut with maternity services. We divided 
these hospitals into three groups depending upon 
f ho si HO of the maternity services; one with services 
earhlg for 2,000 or more admissions a your; the 
second with services from 1,000 to 2,000, and the 
third with maternity services below 1,000 births 
a year. We found, in reviewing the data, that the 
largest group had an average occupancy of 70,6 
percent, (ho middle group had an average occu- 
pancy of 59.0 percent, and the smallest, service had 
tin average occupancy of 43.fi percent,. Subjecting 
this group experience to Fisher's JCxact Tost, wo 
found these differences in occupancy to he statis- 
tically significant. 

Is there a reflection in the "cost," resulting 
from this lower occupancy? We used as our cri- 
terion hero the figure of direct cost of routine serv- 
ices ; this figure would be free of different patterns 
of utilizing ancillary facilities. The direct cost of 
routine services per patient day for these three 
groups is $6.22 in the larger group it rises to 
$6.97 in the middle group and to $10.55 in the 
small group. Theoretically, having a baby is 
fairly standardized procedure and should result 
in standard costs. 

We did correlate these direct costs with the 
number of floor nursing hours and correlations 
were .95. We felt then that, the figures reflected 
the actual personnel costs in a maternity service. 

Wo then looked at the net gain or loss on 
maternity days for these hospitals, knowing full 
well that this is a very "dirty" figure which in- 
cludes direct and indirect costs find overhead, 
counter-balanced with a very unrealistic pricing 
system. However, we were curious to find out if 
there is an effect on gain or loss per patient day, 
depending on the- size of the service. 

Again depending on the. SIKQ of the unit, we 
found that the large hospitals, on the average, ac- 



tually made $1.51 per patient day on the maternity 
service. The middle group lost $.80 per patient 
day, while the small group lost $7.87 per patient 
day on their maternity service. Therefore, we 
seemed to have isolated something that we feel is 
a basic economic fact a relationship between the 
size of the service, and the economics of the service. 

It is quite possible that some of the effects 
of changing patterns of utilization mentioned here 
might or might not have an equally important 
effect on hospital economics. 

The main purpose of computer simulation, 
is 1he generation of predictive and analytical in- 
formation. Thus, once we refine these programs, 
wo may bo able to predict the economic effects of 
various possible alternate decisions open to ad- 
ministrators in the operation of hospitals or to 
planners in the construction of hospitals of certain 
size, or of decisions made by doctors which dictate 
certain utilization patterns, 

One of the things which really intrigues 
us is the possibility of a "5-day week" hospital. 
If wo view the hospital as a mixed system whose 
input is partly random and partly scheduled* how 
can we- play with the schedule so that most of the 
patient-caro load can be taken care of in a 5-day 
week so that yon might be able to shut down 40 
or 50 percent of the hospital over the weekend. 
Again, wo think we are going to bo able to try 
this out on computers. We certainly would hate 
to build up ti nice big 200-, 300-, or 400-bed hos- 
pital in order to experiment with this and then 
fall flat on our faces. We feel that predictive in- 
formation from the computer is a far more de- 
sirable way of assessing the effect of these new 
utilization patterns. 

DISCUSSION 

DR.BRESLOW: 

John's remarks wore directed toward the 
question of efficiency of hospitals in an economic 
sense. Wo certainly need studies of this sort. 
However, T would like to go back to the initial 
point, that ho made, namely, that inpatient ob- 
stetric naro on the West Coast is about half the 
number of days in New England. The question is, 
which is right, if either? Which is closer to being 
right? 

I do not think we are going to get at this 
question by studying economic efficiency or even 
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by getting the testimony of experts in obstetrics. 
We must get io the question of what we are trying 
to accomplish with the maternity service, We 
want- live babies, live mothers. We want a mini- 
mum of morbidity. We want certain social out- 
comes. One could sit down, it seems to me, and 
establish a list of criteria the "so-what" or end- 
result criteria based on the aims of maternity 
service. 

We could agree, even on the East and West 
Coast, as to the aims of a maternity service, ex- 
pressed in terms of patient outcome. Then wo 
could examine the outcome of the two different 
patterns of care and determine which pattern 
yields results closest (o the ideal or whether there 
is any difference. 

In listening to the discussion today, one 
might get the thought that those responsible for 
the mental hospitals, the most backward part of 
our whole hospital system, are amon' (he first to 
ask the "so-what" questions. Bob Felix recently 
announced that if certain things are done in the 
community, within 20 years we will not have any 
more State mental hospitals; they will he a thing 
of the past. Already tuberculosis hospitals are 
becoming things of the past in many parts of the 
country. Mnybe more of our services would be 
"things of the past," if we used the test of what 
is being accomplished with the service being 
provided. 

MR.FTTCHS: 

Without disagreeing with what yon said, I 
feel obliged to point out that even after you have 
applied your "so- what." comparison, you are not 
free -of making an economic analysis in the situa- 
tion also. You might find that at the cost of $500 
million in extra hospital services you are able to 
achieve a half percent better performance on your 
"so- what" measure. Then (he economist would 
ask you to balance that off against other uses that 
might be made of hospitals or physician services 
in terms of preventive care or annual checkups or 
something else. You would still be strung up on 
the fact that the resources are scarce, and any 
time, of course, resources are scarce, you have to 
make an allocation decision which involves an 
economic dimension. 

THE CHAIRMAN: 

Lestei-, I want to come back to something. 
You picked up your theme in your first remarks, 



but I think you have to go a little further. I 
don't think anybody objects to what you are say- 
ing. But yon are describing an awfully difficult 
measurement, are you not, when you talk about 
attempt ing to measure your results? 

DE.BEESLOW: 

Such measurements may be difficult. How- 
over, take the case of cancer, which accounts for 
something like 10 percent of the hospital days in 
general hospitals. What kind of hospital service 
should we have for cancer? Cancer experts will 
tell you that you need surgery, pathology, radi- 
ology, certain specialised equipment for cobalt 
therapy, and the, like. That is one way of getting 
at the problem and perhaps it is the best way of 
getting at it at the moment. However, it seems 
to me that the heart of the matter is what you are 
accomplishing with the cancer service. How 
many lives are you saving ? How much morbidity 
are you saving ? 

In many parts of the country cancer pa- 
tients are now being followed over a period of time 
to ascertain the outcome of treatment. If you can 
do that, you have the basis for comparing various 
types of treatment and determining what kind of 
service and what utilization of that service yields 
the best results. 

The same type of thing can be extended to 
other types of hospital service, such as obstetrical 
service. In the case of rehabilitation recently, as 
in any new medical or social service, one must pre- 
sent justifi.fiat.ion with rigorous studies as to end- 
results. Perhaps we should extend the same type 
of evaluation to older services as well. I would 
agree with Victor Fuchs that it is necessary ulti- 
mately to get hack to economics for the operations 
research equation : how much is it going to cost in 
relation to what yon are going to accomplish and 
what alternatives are available? Here I am at- 
tempting to point out that we have to set our 
sights on what we are aiming to accomplish, and 
measure the effectiveness as well as the efficiency 
of the service for the operations research equation. 

Iffi. THOMPSON: 

I would not, want anybody on the panel or 
in the audience to feel that I think that the per- 
cent of occupancy is the ultimate criteria of the 
qualify of medical care or that, economics neces- 
sarily are. What, I am trying to say is that we 
arc now developing tools, at least in a limited 
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sense,, with which, once the goals of the hospital 
have been set, we can tell you in a rough way what 
arc. the economic implications of these goals. Up 
until now we have not been able, to do this. We 
really have not been able to make what we call 
"trade-offs." We can now say (hat it costs us this 
much to do this kind of program and this much to 
do this kind of program. The computers into 
which we feed this information do not care if the 
average length of stay is 2.8 clays or 4.5 days as 
far as maternity is concerned. These are medical 
decisions. 

I think what we really need is more con- 
sideration of the validity of these medic nl decisions 
affecting the utilization of hospital beds. That is, 
wo need a clearer definition of the goals, a clearer 
definition of what "should bo" so that someone can 
say: "All right, gentlemen, this is going to cost 
you so much money and these are the kinds of re- 
sources you are going to have to provide to carry 
out this program. Do you want to do it or don't 
you want (.0 do it ?" 

MR. FKLDMAN : 

In general, the major problem in conduct- 
ing a "so- what?" study is the absence of random- 
ization. For instance, with respect to the study 
Dr. Breslow was describing, we must- take into ac- 
count flint the patients in voluntary hospitals are 
gonerally of higher socioeconomic status llum 
those in county hospitals. Socioeconomio factors 
can influence recovery rates. Perhaps wealthier 
individuals don't have to go back to work so soon, 
perhaps they benefit from earlier diagnosis, or per- 
haps they receive better postoperative outpatient 
care. There are not many "natural" situations 
where we do not have a number of confounded fac- 
tors. While confounding does not necessarily lead 
to spurious interpretations, there is always a pos- 
sibility that it will. This suggests that we main- 
tain a high degree of vigilance for siliiat ions where 
a procedure approximating randomization is pos- 
sible or where a "natural" experiment, is taking 
place. For instance, conditions where the usual 
practice with respect (o length of hospital stay 
varies between entire oonwwnities, as it does in 
maternity cases, afford us an excellent opportunity 
for research. There are undoubtedly other similar 
situations where the dangers of spuriousness are. 
minimal. II is worth paying a substantial price 
to avoid these dangers. 



MR. PENCHANSKY: 

T think that the two points being discussed 
are, of course, most important. We should espe- 
cially note their interrelationship, 

The tool that Dr. Peterson has discussed, as 
well as some of the others, is aimed at ensuring 
quality services in terms of minimizing unneces- 
sary surgery and hospilaljzation. This tool could 
also be used in establishing standards for hospital 
stays for specific conditions, given certain affect- 
ing^ factors. Though the approach is aimed at 
utilization, it does not seem to me to be an opera- 
tional control procedure which would be applicable 
to a large number of hospitals. Its influence 
would he through medical education, both in 
schools and hospitals, and thus it might have a 
long-run influence on utiliantion. These tools do 
not provide a basis for planning. 

On the other hand, John Thompson's ap- 
proach, if it is to be used in planning for hospital 
beds, must be based on assumed utilization rate 
and hospital stay. HP, says that any rates can be 
employed. However, in planning, say, a maternity 
facility, if the length of stay changes over time, 
then this must be taken account of or there will 
bo either too many or too few beds. It is of utmost 
importance then for us to promote research which 
will provide us lull data on utilization rates and 
length of stay which provide for high quality care, 
then planning can take place not on the basis of 
what does, because of historical and. other reasons 
occur but, rather, what, should take place to maxi- 
mize our health goals. This does not assume that, 
(here are certain very specific rates we can find 
or use but, rather, that we can probably reduce 
many of (-he major discrepancies in utilization and 
stays and arrive at much better estimates of the 
optimal rates for certain types of services. 

Therefore, I think that Dr. Bveslow's point 
is most important. We have to attempt to dis- 
cover which utilization rates and stays provide the 
best care the "so- what" studies. Then these esti- 
mates can bo used as a basis in hospital planning, 
and the longer-run programs of education and con- 
trol can b& undertaken to effectuate these rates in 
practice. 

DR.BARSAMIAN; 

I would like to comment on this. It does 
really emphasize what we are attempting to say. 
These men, at the community level, have come up 
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nth this thinking. Then, when you send it to the 
'omputer, the computer will Ray "so what" Tins 
s really important.. 

I would like to ask Dr. Breslow a, question 
ibout (his cancer study, which interests me very 
nueh. There are some cancers which have a aero 
mrvival no matter -what you do. However, the 
figuro in relation to the survival of cancer is 30 
percent. 

DR. RKESLCnV: 

The cases arc called localized, based on 
clinical judgments supplemented by whatever 
pathologic evidence may he available subsequently. 
The relative survival rate is one adjusted for mor- 
tality from causes other thau caueor at. the appro- 
priate age. Five-year survival rate of male pa- 
tients with localized cancer of the esophagus 
treated in the county hospital was 3.6 percent, very 
low, of course. In private hospitals it was 4.1 per- 
cent,. In absolute numbers (here is not, very much 
difference but, consistently, throughout almost all 
sites, the sumo gradient is there. 

In the county hospitals, patients with local- 
ized cancel- of the pancreas survived to the extent 
of only 2.2 percent but in private hospitals it was 
4,0 percent,. One- can go through almost every site, 
limit (ho comparison to localized cases, adjust for 
ago-specific mortality from other causes, and find 
(ho difference between private and public hospital 
patient experience. 

"Wo could discuss for many weeks the pos- 
sible significance aud the further studies that 
should bo done. The point I am attempting to 
make is that these kinds of studies not. limited to 
cancer, hut including other hospital services also 
should bo undertaken. Wo need to know the rela- 
tive outcome in different, pal terns of hospital care. 

DR. PETERSON: 

I very much approve the end-result sort of 
study, I think it should be applied in this case 
because I want people to retain some doubt about 
the curability of cancer inasmuch as cancer death 
rates seem to bo remarkably stable. I am reminded 
of the long bitter fight about the two treatments 
for cancer oi the breast' and the intense interna- 
tional qua-n'els over this question. Finally a well- 
nontrollecl study was done and both seemed to be 
ibout as effective or ineffective, 

I also think you have to take into account 
ict that there are different kinds of problems. 



Cancer is suitable for the- "so-what" kind of con- 
clusionan interesting new name for the end- 
result. However, there arc other diseases than 
cancer, and since I am particularly interested in 
certain kinds of surgery, I would like to use ex- 
amples from gynocology. The commonest justifi- 
cation for a hysterectomy is uterine bleeding and 
yet this disease can he successfully treated by a 
skillful medical gynecologist or occasionally minor 
surgery specifically a D and C. This kind of 
disease is unlikely to benefit from the end-result 
study. If you take the uterus out, you arc going 
to cure the bleeding. However, there are all sorts 
of alternative treatments. Medical treatment or 
surgery will both produce the same outcome. The 
value of the less dangerous medical treatment can 
only be appreciated if the process is studied rather 
than the result. 

I would also like to mention one other thing, 
especially since we have* present hero some of the 
people from the Public Health Sendee who have 
something to do with our destiny as research work- 
ers. Most of you know many techniques that could 
bo applied in many investigations, as was discussed 
yesterday. I think most of us are aware of the 
many interesting problems and associations there 
are to be explored, but the trouble with most of 
us is that we are constantly running out of funds 
aud we often have, other demanding duties. There- 
fore, it would l>e difficult to expand our research 
m the many directions suggested today; for exam- 
ple, to examine populations from which study pa- 
tients come, or to find out relationships of our ma- 
terial to population. 

This brings one down, of course, to the ques- 
tion I think is becoming increasingly of concern 
to all of us : the manner in which research is sup- 
ported. If we are to continuously spend a large 
part of our time raising money (and occasionally 
we do have difficulty in raising such money), it 
creates a problem in building the sort of teams with 
which one can do the many interesting things that 
one might with each research problem. 

THE CHAIRMAN: 

I have one comment on the comments made 
on the other side, of the question. Lot's assume 
that your paper outlines what you think are the 
criteria for measuring proper practice in one seg- 
ment or one illness and you find maximum varia- 
tion. I think the question raised is : Is that solely 



for improvement of teaching in medical schools, 
which will be (he result if you find variation? 

BE. PETERSON: 

I do not know. I have always thought of 
this problem of what happens in hospitals as being 
much more related to the problem of hospital or- 
ganization. The only person who was, I think, 
close to discussing this particular subject today, if 
I interpret, your remarks correctly, was Dr. 
Thompson. 

It seems to me that wo have the knowledge 
and ability to practice far better medicine within 
our hospitals than we do ; and this, I think, relates 
more to the organization and structure of our hos- 
pitals than it docs to how we are training medical 
st.ndents at the present time. 

MR. FUCHS: 

Might it also relate to financing of medical 
care? Suppose you discover that there is a high 
correlation between unnecessary hysterectomies 
and f eo for service surgery ? 

DR. PETERSON: 

I suppose that the very bitter light going 
on about whether (lie Government is going to help 
finance medical care for the aged involves this 
problem. I have talked to quite a- Jfow general 
practitioners, who have a great fear that if Gov- 
ernment begins to help pay the bill, the Govern- 
ment will begin to ask questions about who is doing 
what and there is a feeling that this may ultimo toly 
end up in what is almost the universal pattern of 
medical care outside of the United States. It 
seems to me, then, that having a hospital appoint- 
ment will he a very privileged 1hing based on ex- 
tensive qualifications rather than following the 
philosophy we have in America, that it is good 
for a doctor to have a hospital appointment, with- 
out nsking questions as to whether it is good for 
the hospital or the patient. 

MR. FUCHS: 

I would say to that physician that whoover 
pays the bill, whether Government, or labor, or 
management, they are going to ask questions and 
are going lo ask for controls. I don't think it 
is a question of Government versus private ! 
think what, is happening is that we are changing 
from a point where the individual consumer paid 



his individual bill and, llu-refore, was not in a 
position to nsk questions or demand controls, to a 
point where hills are going 1<J be paid collectively 
in some form or other. Onco (hat happens, you 
are going to get quosl ions nskcd and you nre going 
to got controls. There Core, I think it would be 
better to put the problem tlm way. What I was 
really asking you was wlu'llior your research will 
get into questions like the rolalions between the 
typo of practice that, you Hint and methods of fi- 
nancing prices rhnrged. For oxiimplt 1 , it, oc- 
curred to me yesterday vditMi you \VIMV spnikingof 
the fact thut men with hi#h <]imliliru Turns probably 
performed better surgery I linn general practition- 
ers do, that maybe they rlinrgo higher prices and 
maybe the difference hot weon quality is nol> in the 
consumer's mind, judged lo bo commensurate with 
the difference in prices clmi'god. This is probably 
wrong but it seems to mo i( is llio kind of question 
that might bo researched. 

DR. PETERSON : 

It could be. Wo are. vory much aware of the 
fact that each hospital IH an individual organiza- 
tion, and wo think wluvt. hiippraifl in surgery is part 
of (his whole problem, hut, ngftin, our TOBOUWOH 
are finite. This is really beyond our proving. 

MR. FBLDMAN: 

What dislinguiahflM hospitals No. 3 and 
No. 4 from No. 1 and No, 2? 

DR. PETERSON: 

I can give* you matovml that impressed us, 
When wo went into hoRpifnl No. 1, a hospital of 
about 200 beds, (hoy hud neven or eight people in 
the record room and ib was a very iiu'JHVicnt opera- 
tion, Wo finally had to find the lust 20 percent 
of tho records ourselves, li, took weeks to Mud 
thorn to complete our sample. Tho next hospital 
was about hal f tho HJKO of No. 1 and had only about 
a quarter as many paopta in Iho record room. 
However, when wo gavo |,ho head record librarian 
tho list, of patients' charts wo desired, she naked us 
when wo wanted thorn. AYo said, "Monday morn- 
ing," and on Monday morning wo bad every last 
ono of them. There w-ns a fftnliiHlic difference with 
regard to efficiency of operation. 

There woro many ol.hcr nspects ol the hos- 
pital which suggested competence! and, therefore, 



began to believe that what was happening in 
irgery was part of the whole picture, 

One of you mentioned one other subject 
r hich I would like to emphasize a bit. This is 
ecoming of increasing concern, particularly to 
ne group in the medical schools the group now 
ttempting to take the old-fashioned outpatient 
linics of teaching hospitals and make them into 
'laces to give good medical care and do good teach - 
ng. They don't know how to talk to patients 
hey cannot get their instructions across to the 
tatients. 

MR. KLAHMAN : 

I would like to make several brief com- 
nents. One point is thnt I think it would be 
lighly important to look at. the kinds of practice 
hat a physician pursued in two or three different 
lospiLals. It seems to me- that this is something 
hat should be feasible and I think you would get 

1 real pay-oft'. 

THE CHAIRMAN : 
The same physician? 

MR.KIARMAN: 

Yes, because I know in Xew York we talk 
ibout differences between proprietary and vol- 
mtary hospitals and yet we know the same phy- 
sician practices in both. Therefore, I think it 
vould be useful to see whether lie does have dif- 
'erent standards. I would not be surprised if he 
lid, but let's find out. 

I would also like to know from Mr. Thomp- 
;on what the effect is of a difference in length of 
itay on the rate, of occupancy. It seems to me that 
f you have, let us say, a difference of 50 percent in 
engtli of stay between obstetrical patients on the 
Vest Coast and the East Coast, we do not get a 
lommensurate saving's because I would assume 
bat a shorter stay will, of necessity, also give you 
lower rate of occupancy. This is bound to come. 

Then I would like to ask Dr. Breslow a 
luestiou : Just what is the evidence thai they have 
[one so well in rehabilitation or in mental health 
n measuring end results? I do not know of any 
vidence but maybe you do. 

DR. BRESLOW: 

Being an expert neither in care of the men- 
ally ill or rehabilitation, I will comment freely 



on tliis. My point was that efforts are being made 
to determine the outcome of care in different situ- 
ations for the mentally ill and for patients receiv- 
ing rehabilitation services. 

Just this morning, for example, I talked to 
Dr. Davies about the studies of the effectiveness of 
rehabilitation in Oxford. T think the evidence is 
quite clear, from people who have visited there 
and also from what has been written about it, that 
I he aggressive rehabilitation program (tied in 
\\ ith community resources, both medical and fam- 
ily resources) leaves far fewer people in the hos- 
pital with long-term illnesses than formerly. 
More of these people are outside of the hospital. 

If to be outside a hospital and functioning 
at home is a desirable goal as a physician and 
public health person I would accept this as one 
general criterion then I would say that the geri- 
atric hospital at Oxford has done a remarkably 
fine job. Similar work is also being done in a few 
places in this country, including evaluation of 
what is being accomplished in the rehabilitation of 
patients with particular conditions, for example, 
stroke. The evidence is beginning to pile up. 
While it is crude and not entirely satisfactory and 
all of us can criticize it, the point is that efforts 
are being made to do this, and I would like to 
extend the same appi'oach to the general hospital. 

THE CHAIRMAN : 

I am sure all of you will join me in looking 
forward to the next two presentations. We are 
delighted to have two representatives of Great 
Britain here to tell us about research there, or to 
make any comments they care to about the activi- 
ties that we have been discussing here as they may 
relate to problems in their country. 

I hardly need introduce these two men, who 
linve traveled many times in this country and who 
are personally acquainted with many in the audi- 
ence, 

Dr. Brotherston is going to cany the main 
assignment. Wo appreciate his taking a week out 
of a very busy life to come over and participate. 

Dr. Brotherston received his medical degree 
and a number of others at the University of Edin- 
burgh, traveled in this country as a Rockefeller 
scholar in preventive medicine and, between 1948 
and 1953 was lecturer in social and preventive 
medicine at Guys Hospital and the London School 
of Hygiene. I could go on listing many other 



pertinent assignments in relation to what we are 
asking him to discuss this morning. PTe is, as your 
program shows, presently Dean of the Faculty of 
Medicine of the University of Edinburgh. 

Dr. J. 0. F. Davies is Senior Administra- 
tive Medical Officer, Oxford Regional Hospital 
Board, Oxford, England. I would guess that 
quite a few in this audience have been over there 
visiting the Oxford Board, which has demon- 
strated new and interesting ways of planning in- 
stitutional facilities and medical care for the pop- 
ulation served in that district. This is in many 



respects a bellwether district for the whole country 
and, certainly, we have all learned ninny things 
from their halfway house and day hospital and 
other organized services. 

Dr. Davies is currently on loan to the Min- 
istry of Health, concerned with coordination of 
the hospital program. I should think that every- 
thing that goes on in the United Kingdom, as 
they endeavor to coordinate their hospitals and 
medical care, is of fascinating interest to us, and 
I gather from the visits we have that what we try 
to do always is to compare values. 



RESEARCH ON HOSPITAL USE IN THE UNITED KINGDOM 



DR. BROTHERSTON: 

At the outset, let me express my agreement 
with Dr. Odin Anderson (1) who, at the com- 
mencement of your previous Conference, took is- 
sue with "the belief that somo objective criteria 
can be established to be followed by the medical 
profession that will provide a scientific basis for 
hospital use. This is understandable but Utopian 
thinking," he said. "The range of 'proper' use in 
hospitals is very great, from admissions for saving 
life (o admissions of comfort and convenience." 
Nevertheless, no doubt we are all hoping by re- 
search to clarify our understanding of the way 
in which hospitals are used at present and the 
needs and other forces which are determining 
their use, so that wo can shape our policies with 
greater clarity for the future. 

It is difficult for me to judge how far an 
account of research in this field done in the United 
Kingdom will be helpful to you. It is even more 
difficult to decide how to select and present the 
material. Medical care systems vary so much in 
their form and usage according to the- social con- 
text in which they operate that generalizations 
from one system to another may be misleading and 
unhelpful. This goes for particular institutions 
(such as the hospital) within medical care systems 
as well as for the system as a whole. There is an 
overall sense, of course, in which the similarities of 
problems, methods, and intentions between the 
medical care systems of the U.S.A.. and the U.K. 
are greater than the differences, but this still leaves 
the possibility, if not, probability, that the differ- 
ences are sufficiently great to make some of the 



research which I will tell you about sound quite 
alien to you, if not positively meaningless. 

It is apparent from piich comparison as can 
be made thtil hospitals, aside from their different 
political and economic organization, are used in 
somewhat different fashions in the two countries. 
In Appendix I, I have tried to spell out a few of 
the differences. II would seem, for example, that 
tho hospital in the U.S.A. is used more frequently, 
although for shorter durations of stay and with, 
apparently, a higher content of surgical activity. 
Table 5 in the Appendix shows (he relative chances 
in (ho 4B-G5 and G5-and-over nge groups of the 
single, widowed, and divorced being admitted to 
hospital in tho two countries. "With us the isolates 
have (i markedly higher relative chance of hospital 
admission, suggesting that our hospitals are used 
to a greater extent to compensate for certain social 
deficiencies as well as to provide clinical care. 

While considering the context in which the 
hospitals operate in tho U.K., one has io remember 
that the National Health Service organization 
took over and intensified the system which hncl 
developed over many years in the U.K. of sepa- 
rating tho medical profession into two main 
groups: I he consultants and specialists hospital- 
based and tending to have a monopoly of the 
technical and other resources concentrated in the 
modern hospital ; and the general practitioners re- 
sponsible for providing domiciliary care and prac- 
ticing from their own offices or surgeries, usually 
with slender supporting technical resources. The 
general practitioner has the monopoly of first con- 
tact with the patient, in other words the consult- 
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ants and specialists (the hospital hierarchy) may 
not normally see a patient unless he is referred by a 
general practitioner. A great deal of the discus- 
sion in the U.K. and some of the research clone find 
planned is directed toward the borderland of re- 
sponsibility between hospital and general prac- 
tice for example the ambulant care services pro- 
vided in hospital outpatient departments and 
certain diagnostic services increasingly being made 
available by the hospital service directly to the 
general practitioner. 

It is notable that the ordinances of the 
Health Service itself have not laid down clear 
dividing lines of responsibility between hospital 
and G.P., but have left these to he worked out by 
planning decision. Since the- establishment of the 
Health Service, the technical trends influencing 
medicine have moved with increasing force to- 
wards more and more concentration of resources 
in the hospital "the medical factory." There- 
fore, definition by planning has tended to circum- 
scribe general practice without similarly narrow- 
ing the remit of the hospital. The National 
Health Service Act says that "a hospital means 
any institution for the reception and treatment of 
persons during convalescence, or persons requiring 
medical rehabilitation, and includes clinics, dis- 
pensaries, and outpatient departments maintained 
in connection with any such institution or home as 
aforesaid," and that "hospital accommodation 
shall be construed accordingly," In other words, 
a hospital is a hospital is a hospital . . . 

Looking to the general practitioners' terms 
of reference for a definition of their responsibility, 
we find it to he "those aspects of the medical care 
of their patients which are not part of the hospital 
monopoly"; so the official definition goes in a 
circle. It may well have been best to omit more 
precise definitions at the start of the service, but 
there is no doubt that an increasing need is felt 
now to clarify the responsibilities of hospitals and 
general practitioners so as to unite them in part- 
nership rather than to separate them, on a line of 
hospital monopoly. It is interesting, for example, 
that the Hospital Plan for Scotland (2) states as 
its first principle that the hospital service has to 
be treated as one part of a comprehensive Health 
Service, that its operations and development must 
be coordinated both with the Local Authority 
health and welfare services and the general prac- 
titioner service; that the scale of hospital provi- 
sion aimed at is based on the assumption that hos- 
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pital treatment and care will be provided only for 
those who need it. We are, of course, still left 
with the fi'1-dollar question : "What is hospital need? 

Another important element of the back- 
ground situation is that we embarked upon our 
National Health Service in the U.K. with little 
tradition of research in the field of medical care. 
Although Britain has been a pioneer in the public 
provision of health services, the basic reconnais- 
sance and planning have tended to be done by 
committees of experts auel informed lay people 
rather than by research teams. In 1860 Florence 
Nightingale (3) said, "I am fain to sum up with 
an urgent appeal for adopting (his or some uni- 
form system of publishing the statistical records 
of hospitals. I have applied everywhere for infor- 
mation, but in scarcely one instance have I been 
able to obtain medical records fit for any purposes 
of comparison." The situation changed little for 
almost a century. In 19G1 Jewkes (4) was able 
to say : "In most, countries less is known about the 
medical services than about the minor industries. 
If ordinary businesses knew as little about whom 
they serve and in what quantities as most countries 
know about the frequency of illness and who makes 
call on the medical services, these businesses would 
rapidly be in bankruptcy. Some obvious excep- 
tions there are. The United States is far in the 
lead in measuring and surveying in order to under- 
stand what sickness means to the community. On 
the other hand, there are countries which seem 
content to remain uninformed and give the im- 
pression that they are not very anxious to know 
what is going on. Britain is one of the backward 
countries in this respect, It is a marvel, and one 
on which foreign observers frequently remark, 
that a scheme so vast as the National Health Serv- 
ice can be carried on with so little comprehensive 
knowledge of its detailed -workings." 

Perhaps WB have been too preoccupied 
with the mechanics of providing services to pause 
to take stock. In the past it was possible t o proceed 
on the assumption that all provision must be good, 
therefore, why waste time over the details. But 
there are major forces at work now affecting the 
medical care systems of all advanced countries 
which completely invalidate such a point of view. 
Chester (6), in an interesting paper to the llth 
International Hospital Congress, delinealed the 
forces of scientific and technological advance in 
medicine and the social demands for higher stand- 
ards of medical care which have so sharply in- 



creased the cost of medical -cure provision that 
those responsible for (lie system seek all possible 
means of increasing efficiency. This need of in- 
creasing efficiency, in (he sense of the best return 
for money and other expenditure in terms of the 
improvement and comfort of the patient, has 
brought about a substantial change in the U.K. 
in recent years. There is now a growing interest 
in and volume of activity in medical care studies. 

The central government departments con- 
cerned, previously without any research organiza- 
tion, are now building themselves up in this 
respect. For the first time they have a financial 
budget for the purpose, and they are evolving 
organisations which bring together medical sta- 
tistics, opera ( ional research, and other appropriate 
techniques. 

One of the most significant developments 
has been tho entry of the General Register Office, 
with its great tradition in this field of mortality 
statistics, into national morbidity statistics. By 
means of its General Practice Morbidity Studies 
and its Hospital Inpalient Enquiry, tho General 
Register Office has made a valuable start in de- 
veloping the tremendous potential the National 
Health Service offers a .statistical system for 
evaluation. The Hospital Inpatlent Enquiry (6) , 
already providing valuable information and full 
of promise, had from the outset a double purpose 
of assisting in the administration of the hospital 
services as well as contributing to knowledge of 
community morbidity. Tho information is col- 
led ed from a random 10-percent sample of pa- 
tients discharged from hospitals. At the earlier 
stages, hospitals were invited to come in on a vol- 
untary basis, and did so in increasing numbers, 
but since 1957 all hospitals have been required to 
participate. The data collected permit tabula- 
tions which give a national picture of hospital- 
treated disease by diagnosis, by type of hos- 
pital, by area, and by certain social charac- 
teristics of the patient. Of course the data have 
tho limitations of their source, and there is still 
much work to bo done in perfecting techniques of 
collection and interpretation. But it can bo said 
that a. very solid foundation has been laid lor a 
valuable and continuing review of hospital work 
which will be a mine of information to the re- 
search worker. 

In Scotland a Hospital Morbidity Survey 
(7) has been initiated by the Department of Home 
and Health for Scotland, based upon data collected 



from all discharged patients. As this survey is 
of much more recent origin, there has not yet been 
fime to process it for public use. For a fuller ac- 
count of sources of information on the Health 
Service, a report by my colleague, Dr. R. J. Peters, 
is included a-s Appendix II. 

Research has found little place in the activi- 
ties of local and regional hospital organizations, 
or other administrative units of the Health 
Service; but there have been some praiseworthy 
exceptions. Birmingham, for example, has made 
notable contributions to the methodology of hos- 
pital records and morbidity recording, and the 
Oxford Regional Hospital Board has seized the 
opportunities which a Regional Board's position 
offers to study the workings of a regional hospital 
service. It has an operational research unit, with 
valuable contributions to its credit, and is entering 
upon increasingly sophisticated studies. Its pro- 
gram of work envisaged or on hand includes an 
evaluation of progressive nursing care, a study to 
attempt measurement of the effects of varying 
lengths of slay in hospital for given conditions, 
the establishment of an experimental ward to try 
out tho effects of varying forms of organization, 
staffing and management at the ward level, and a 
study to clarify how far and for what periods 
patients are dependent on nursing staff. 

No description of research in this field 
would be adequate without special mention of the 
work of tho Nuffield Provincial Hospitals Trust. 
Even before the Health Service was established 
tho Trust was in the field, and since the early days 
of tho service it has fostered and supported work, 
some of which have been outstanding. Many stud- 
ies mentioned in this paper have been suppoa'ted by 
it, and if we are now in a position to move ahead 
effectively on a wider front, this is due primarily 
to the work supported by the Trust, Its useful- 
ness has convinced the doubters, and it hns shown 
the way forward in methodology. The volume 
on the Functions and Design of Hospitals (8) has 
already become a kind of classic in our literature, 
and the methods it described have influenced sub- 
stantially our research and planning for hospital 
organization and building. 

The paper by Chester already mentioned 
outlines a possible framework for thinking about 
research in the field with which we are concerned. 
Ho poses four questions for consideration when 
thinking about the best use of hospital resources. 
Are we satisfied that our domiciliary sei'vices are 
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efficient in keeping people out of hospital, and in 
getting: them out again quickly if they have to 
be admitted? If patients musf go to the hospital, 
is it really essential to admit them as full inpa- 
tients? For those who must be inpatients, are we 
satisfied that we ave making the best use of our 
resources of beds, equipment, manpower, etc.? 
How do we ensure in planning our future hospitals 
that we make the best use of funds available? I 
propose to use his questions to order my descrip- 
tion of work clone in the TT.IC., but T shall reverse 
his order and start first with planning and hospital 
provision. 



Planning the New: How Many Beds and How 
Should They Be Deployed? 

We have had a variety of estimates of bed 
requirements in the past, based on intuition, rule 
of thumb, or replacement estimates. The approach 
of the first major capital building prog-ram for the 
Service sharpened our attention to the question. 
When the capital cost of new hospital provision 
averages 5,000 to 10,000 pounds per bed, it becomes 
a matter of some importance to get estimates as 
nearly correct as possible. We needed something 
more precise and up to date than the wartime hos- 
pital surveys. A number of studies have been car- 
ried outj but significantly, none make any claim 
to provide a direct estimate of need as a guide to 
hospital provision. There seems to be tacit agree- 
ment that "need" in this context is too variable and 
elusive a concept to be measured. Instead, meas- 
urement of manifested demand is substituted, with 
the addition of various calculations designed to ad- 
just the sum towards a measurement of need. 

The first surveys were carried out in Ayr- 
shire and Stirlingshire in Scotland (9). These 
were primarily total hospital morbidity surveys of 
all residents in these counties throughout a year, 
but a calculation could be made of the total in- 
patient hospital care of all kinds, which worked 
out at 2.375 days per head of the population per 
annum. 

Later studies concerned with manifested bed 
demand rather than with morbidity have followed 
the less laborious method made familiar by 
Bailey (8). The method applies queuing theory 
to the establishment of a "critical" number of beds. 



In any year the number of patients recommended 
for admission (i.e., inpatient deaths and dis- 
charges plus or minus the change in waiting lists 
for admission to hospital) multiplied by the aver- 
age duration of stay of the patients died and dis- 
charged gives the number of bed days which would 
ha-ve been spent in hospital had all the patients 
recommended been admitted. The total number 
of bed days divided by the number of days in the 
year gives the critical number of beds at an oc- 
cupancy rate of 100 percent. The actual number 
of beds required can be estimated by adding to the 
critical number twice the standard error attached 
to the sample, plus one or more beds according to 
the rate at which it is desired to run down the lists 
of those waiting for admission. The final rate is 
usually scaled clown and expressed at a more real- 
istic occupancy rate, such as 85 percent. To calcu- 
late the population "at risk" so far as the hospitals 
studied are concerned, hospital records over a wide 
area are surveyed ; and thus manifested demand 
can be expressed in bed rates per 1,000 of popula- 
tion (10). More recently Bailey (11) suggests 
that in certain situations it may not be necessary to 
calculate the population at risk, and offers a 
method of estimating bed provision for a specialty, 
employing calculations which use the figures of 
change in manifested demand revealed by the wait- 
ing list, and also the figure of "optimum duration 
of stay" as defined, for example, by the medical 
staff concerned. Variation in demand can be met 
by varying duration of stay. 

The first studies of this kind were carried 
out by the Nuffield Provincial Hospitals Trust in 
the Norwich and Northampton areas. Later ones 
using the same methods have been made, for ex- 
ample, by the Oxford Regional Hospital Board in 
Reading (12}\ To test the method and to obtain 
comparative figures in the different social setting 
of the North of England, Forsyth and Logan (13) 
carried out a study in Barrow and Fin-ness, and 
Airth and Newell (14) surveyed the Tees-side 
region. 

The "critical number" in these studies came 
out at figures ranging between 2 and 3.6 acute beds 
per 1,000 population at 85 percent occupancy rates, 
all figures being substantially lower than the esti- 
mate of 7 to 8.5 beds per 1,000 which had emerged 
from the wartime hospital inspections. All the 
estimates have in common the fact that they ap- 
proximate very closely to the actual bed provision 
for the populations concerned. The limitations in- 



herent in the technique becomes apparent. As 
Abel-Smith (15) has said, "It was found that areas 
which already had fewer hods seemed to need fewer 
beds, while those having more beds needed all the 
beds they had. Despite all the talk about hap- 
hazard hospital development it appeared that sup- 
ply was really equal to demand. How wise our 
forefathers had been ! Or how bad our interpreta- 
tion of the statistics. What we had discovered was 
Say's Law. Within limits, supply creates its own 
demand. When general practitioners know that 
hospital beds are short, they don't hospitalize pa- 
tients who are not desperately in need. They treat 
them at home and get used to doing so. And it is 
only a matter of time before traditional medical 
care becomes regarded as good medical cam 
When hospital doctors know that beds are short, 
they reduce the length of stay. When they know 
they are plentiful they increase the length of 
stay." 

Airth and Newell in their study looked at 
the relationship between supply and demand for 
beds in four specialties, in four hospital regions of 
England and Wales, and found it to be almost 
linear ; and others have drawn attention to the same 
phenomenon of supply apparently determining de- 
mand. Nevertheless, the technique seems to be the 
best we have available. If it is to be used in plan- 
ning, however, it is essential to appreciate its 
limitations fully; otherwise there is a real danger 
that we may be taken in by our own figures, and 
begin to confuse "manifested demand" with real 
need.. Forsyth and Logan (13) quote Professor 
Devons as saying, "There is a passionate desire in 
our society to see all issues of policy decided on 
what we think are rational grounds. We rebel 
ftgairist any admission of the uncertainty of our 
knowledge of the future as a confession of weak- 
ness. What easier way to pander to this obsession 
than to have all issues debated in the scientific or 
pseud oscientific language of statistics?" 

Some of the studies quoted throw a little 
light on the phenomena which lie behind this ap- 
parent equilibrium of supply and demand, but 
only enough light for us to see that the demand is 
mads up of a series of forces each with a wide 
range of variation. There are differentials of 
morbidity, of course, but the relationship of these 
to demand is not well understood and is apparent 
only where the differentials are fairly gross, 
There are differentials in social and demographic 
factors; the status of the population in terms of 



age, sex, and marital status is influential. Perhaps 
the clearest display of this appears in the inter- 
esting analysis of the hospital population of Eng- 
land and Wales in the census of 1951, a study un- 
dertaken by Abel-Smith and Tit muss (16) and 
referred to in Appendix I. There are differences 
in standards of housing provision, but these are 
unevenly effective; differences between rural and 
urban rates which suggest differences in social cus- 
tom as well as in environment and morbidity; dif- 
ferences of social class behavior e.g., in relation 
to such operations as circumcision and tonsillec- 
tomy the degree of pressure for elective surgery 
and other pre-planned uses of the hospital services 
tending to increase with higher socioeconomic 
status (14). There are marked differences be- 
tween general practitioners in the extent of refer- 
ral of patients to hospital within the same areas, 
which do not seem to be readily explainable -in 
terms of any simple characteristics of the doctors 
concerned, such as age, qualifications, size of prac- 
tice, extent of use of laboratory, X-ray, and other 
services (13). Barr (12) points to the important 
unexplained problems behind divergent use by 
similar types of ai'ea, and says that there tend to 
be strong correlations between level of use for 
different types of hospital service in a given area. 
Three assumptions go along -with the "crit- 
ical number" method of estimating demand, if it is 
to approximate to a measure of need. The wait- 
ing list should be a meaningful expression of un- 
satisfied demand : this "waiting-list for admission" 
unfortunately has been shown to be varyingly up 
to date and realistic in this respect (17). There 
should be no recognized additional unmet demand 
such as can be ascertained by canvass of local gen- 
eral practitioners. Cases admitted to hospital 
should be genuinely in need of hospital treatment, 
and should stay there only for as long as is neces- 
sary on medical grounds. 

Studies have been made in acute hospitals 
to assess the inpationts in this last respect. Broad- 
ly the methods employed have been similar; cri- 
teria of hospital need have been laid down and 
applied to each patient in the hospital population 
studied. Ifc was one of the special intentions of 
Forsyth and Logan (13) in their study in Barrow 
and Furness to test this particular point. They 
found a substantial number of patients who on 
strict medical criteria did not need hospital care. 
The difference was greater for medical patients 
(where 25 percent of the male patients and 40 
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percent of the female patients were so classified) 
than, for surgical patients. Tu Birmingham, 
Crombie and Cross (18), one of whom was a gen- 
eral practitioner, took part in a similar type of 
assessment study, and judged that a quarter of 
the patients in the medical wards visited "had no 
diagnostic or therapeutic requirements at hospital 
level." On the other hand, Mackintosh, McKeown 
and Garratt (10), also in Birmingham, in an as- 
sessment of patients in (he medical wards of three 
largo general hospitals came to the conclusion that 
only 13 percent did not need hospital care on 
strictly medical grounds, and that in only 4 per- 
cent of cases admission might conceivably have 
been prevented hy augmented domiciliary medical 
and social services. 

It may he assumed that estimates of "man- 
ifested demand" 1 ' as indicators of need are at (heir 
most reliable in situations whore demand is rel- 
atively stable in terms of morbidity problems 
whose suitability for medical care is well under- 
stood by the public, and where the therapeutic 
approach is not changing rapidly. Evidence sug- 
gests that they provide a better estimate for surgi- 
cal needs than for medical conditions. The point 
is interesting in (erms of certain controversial 
estimates which have been made for England and 
"Wales of the future bed needs for menially ill 
patients. Tooth and Brooke (20) and Brooke 
(21) have estimated the future need for beds for 
such patients in the light of the changing thera- 
peutic situation in psychiatry. Their calculations 
are fairly elaborate, since they involve estimating 
by cohort analysis the rundown of the large pro- 
portion of long-stay patients who at present oc- 
cupy many hospital beds, as well as estimating the 
needs for shorter-stay patients. Basing their cal- 
culations on experience over the 5-year period 
1955-59, they forecast a need for 1.8 mental beds 
per 1,000 population, a virtual halving of the 
present number of beds. Perhaps the truly re- 
markable thing is that this estimate lias been im- 
mediately accepted by the Minister of Health, who 
has incorporated it in the 10-year Hospital Plan 
for England and Wales (22). Never surely out- 
side the armed forces has the operational research- 
er's advice been acted upon more swiftly or on a 
larger scale. There is considerable controversy 
over this decision at present, the basic assumptions 
on which Tooth and Brooke made their calcula- 
tions being questioned by some. I find the calcu- 
lations less doubtful than their interpretation. 



Policy on euro of mental disease is in a state of 
considerable flux at present in the U. K.; and 
there are assumptions behind present procedures 
of early discharge which are, as yet, not fully 
tested. This is the kind of unstable situation in 
which caution is necessary in estimating short- 
run data and elaborate extrapolations from them. 
Let mo add that the Secretary of Slate for Scot- 
land in the 10-year Hospital Plan for Scotland 
(2) has been much more cautious than his English 
colleague. 

The deployment of hospital beds has had 
some research attention in the U. K., and our 
thinking has been clarified by a serins of studies 
made by McKeown and his colleagues in Birm- 
ingham on the medical and nursing care needs of 
patients in the Birmingham area for all cate- 
gories of hospitals. Their work started with 
studies of the chronic sick made about the time of 
changes in hospital organization which followed 
the introduction of the Health Service (23), 
changes which highlighted the problem of hos- 
pital caret for chronic sickness in an aging popula- 
tion. (They hare recently reassessed the position 
of the chronic sick.) (19) Their next studies 
wore concerned with patients in ,a tuberculosis san- 
atorium (24), mental hospital patients (25), and 
finally patients in acute hospital wards. 

The methods employed in all the surveys 
were similar. A clinical and nursing assessment 
was made and each patient was allocated to one of 
four categories: patients who needed full hospital 
facilities, such ns frequent medical attention and 
skilled nursing; patients who needed only limited 
hospital facilities essentially simple nursing 
(washing, dressing, feeding, attention to bladder 
and bowel, etc.) without medical supervision; pa- 
tients who needed only limited hospital facilities 
essentially supervision because of their mental 
state with (in a few cases) simple nursing; pa- 
tients who needed no hospital facilities, but re- 
mained in hospital chiefly for social reasons. 

They came to the conclusion, having as- 
sessed the needs of all Birmingham patients in 
hospital, that their distribution between mental, 
chronic, and general hospitals was determined 
largely by age. "Those needing the full facilities 
of a, modem hospital are in general or mental hos- 
pitals if they are young, but in late life they are 
mainly in chronic hospitals. Those needing limit- 
ed hospital facilities with or without medical sup- 
ervision are distributed arbitrarily between chron- 
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ic, mental, and general hospitals according to ago 
rather fhfin the type of care they require." They 
add thai "these results show the desirability of re- 
moving the tradit ionul divisions between the major 
classes of hospitals and placing patients in facili- 
ties which are appropriate to their needs." (26) 

An interesting recent study by Kidd (27) in 
Belfast has suggested that misplacement of the 
patient in the wrong kind of hospital may do 
positive harm. Ho examined the progress of pa- 
H cuts aged 00 and over in the geriatric unit and 
mental hospital. He classified them according to 
whether they had been placed in the correct type 
of hospital. In both units, the misplaced patients 
had a higher mortality than equivalent cases cor- 
rectly placed. 

On the basis of his work McKeown has 
founded his idea of the Balanced Hospital Com- 
munity. From iho fact that mental illness and 
breakdown of health from degenerative disease in 
older ages are certain to bo an increasing propor- 
tion of the total problem of medical caro, he con- 
cludes that they should be brought back into close 
association with the main sf ream of medicine. The 
whole concept of the hospital should bo re-exam- 
ined in the light of this assumption, and rep] aimed 
to bring the various categories together in a hos- 
pital community with varying lypes of provision 
according; lo the medical and functional needs of 
the patients. 

It is of considerable interest that McICeown, 
with support from the Nuffield Provincial Hos- 
pitals Trust, is carrying his ideas forward in a 
planning exercise io discover the needs of such 
a proposed hospital community grouping. The 
exercise goes beyond the conception of institutional 
care. The aim underlying the project is that all 
nspects of health care should bo integrated and 
present divisions between general practitioner, 
local authority, and hospital services broken down. 
According to the plan, all types of institutional 
caro should bo provided on one site in proportion to 
the needs of the community served, and a notional 
site has been chosen adjacent to the main teaching 
hospital in Birmingham. The plan postulates 
sewing a- surrounding population of 120,000 peo- 
ple a population group large enough to provide 
a reasonable spectrum of community needs, but 
not too large for detailed study. The program of 
work has three main stages. First is the collection 
of background information concerning the demog- 
raphy and topography of the area. Second is the 



definition of a series of "patterns of care" for each 
health facility in the scheme these include ma- 
ternity, pediatrics, mental health, geriatrics and 
the acute sick at all ages. From these patterns 
the final stage of investigation will be developed, 
consisting of the preparation of an architectural 
scheme for the development of the site. Only 
after that can it be judged whether the project 
is viable. 

Clearly there are certain types of medical- 
care research which can be can-ied out only by the 
experimental method. This is certainly the most 
advanced experiment yet proposed in the United 
Kingdom, where experimental approaches to solv- 
ing health care problems have been restricted in 
the post-war period largely for financial reasons. 



Do We Make the Best Use of Our Existing 
Hospital Resources? 

EFFICIENCY IN BED USE. An im- 
portant, if humdrum, development has been our 
progress towards an agreed method of arithmetic 
to describe betl use, after solving elementary prob- 
lems of definition. We are building up the experi- 
ence on which tin eflicient discipline of vital sta- 
tistics of hospital lisa can be based. As with other 
vital statistics, the quality of the information pro- 
duced depends on the validity of the basic data. To 
improve these, a slow and steady process of educa- 
tion is necessary, together with the realization by 
those whose job it is to look after the basic records 
that these are really useful, and used. 

Benjamin and Perkins (28) have dealt re- 
cently with the current methodology of bed-use 
statistics. Their paper illustrates the value of 
a more sophisticated consideration of conventional 
routine statistics. Again attention is drawn to 
the fallacy of using the occupancy rate as a meas- 
ure of efficiency without taking account of the turn- 
over, or empty-bed interval. They illustrate by 
quite simple models the great increase in work- 
load which is involved in quite small reductions of 
average duration of stay, and also of turnover 
interval, 

In order to meet increasing demand with 
the same number of beds, there has been contin- 
uous pressure to examine statistics of duration of 
stay, turnover interval and occupancy, and a sub- 
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stantial and steady acceleration in the pace of work 
has taken place. This is one field of medical care 
where trans- Atlantic comparisons seem to exert 
their influence upon us. Curiously enough, with 
trends towards shorter durations of stay, no one 
seems yet to have attempted to assess what differ- 
ence this makes to the acute hospital patient, al- 
though Oxford Regional Board are proposing to 
make such a study. One grave deficiency of our 
methodology is that we have, as yet, no effective 
means of taking rcadmissions into account in our 
balance sheet of results from the statistics of 
patient care. 

We have only partially succeeded so far 
in molding our routine hospital statistics into the 
shape of an external audit permitting effective 
comparison between different hospitals and re- 
gions and fruitful discussion of differences. There 
is not yet sufficient uniformity of processing and 
presenting data to permit this to be fully effective. 
Nevertheless, increasingly comparisons are being 
made which create pressure for uniform methods 
of processing and presentation. Potentially we 
have the whole hospital system at our disposal for 
routine comparisons of the simple criteria of hos- 
pital activity. 

The Hospital Inpatient Enquiry has great 
possibilities in this respect, although the fact that it 
is based on a 10-percent sample restricts its use- 
fulness for comparison between small units. 
Among other features for comparison, the Enquiry 
in disclose differences in waiting times before 
dmissiou to hospital, which require further in- 
estigation for example, figures noted for one 
region in 1955 show waiting times of over a month 
for some cases of breast cancer, suggesting either 
administrative failure or shortage of facilities 
(29). 

Oxford Eegional Hospital Board have es- 
tablished a procedure of processing their own 
copies O-C the data supplied to the General Register 
Hospital Inpatient Enquiry. Their statistical 
unit is building up a series of regional studies of 
hospital differences based on these data, which 
forms a useful comparative study. For example, 
widely differing durations of stay were shown 
among the regional hospitals; the mean range for 
appendicitis without peritonitis was 6.3 to 11.8 
days, and for hernia without obstruction the means 
ranged from 6.2 to 13.4 days (30) . 

Lee, Morrison and Morris (31), making in- 
teresting use of the Enquiry data for a. set of 



comparisons between teaching and nonteaching 
acute hospitals in respect of fatality rates from 
appendicitis, perforated peptic ulcer, and hyper- 
plasia of the prostate, have shown consistently 
more adverse experience in the nonteaching hos- 
pitals. They found the same situation with dia- 
betic coma. After allowance was made for factors 
which might have led to selection of patients of 
different prognosis in the two groups of hospitals, 
the differences still remained. They draw atten- 
tion to the markedly more favorable situation 
with regard to staffing surgical, anesthetic and 
nursing in the teaching hospitals. 

Admission policies affect bed usage, and 
large towns have a Bed Bureau system to which 
a general practitioner may apply for assistance in 
finding a hospital bed for his patient. Reference is 
frequently made to the fact that aged patients, 
oven those suffering from acute conditions, are 
more difficult to get into hospital than those 
younger. The Emergency Bed Bureau of the 
Liverpool Eegional Board (32) carried out a study 
to find whether this is in fact so. The doctor sub- 
mitting the patient approaches the Bed Bureau 
and gives particulars of the patient. The Bed 
Bureau then contacts hospitals, giving the pa- 
tient's age and diagnosis, until the patient is 
placed. As each hospital is contacted the time is 
recorded on tho case sheet. In the survey, the time 
which elapsed between receipt of tho request and 
the acceptance was used as tho index of ease of 
admission. The average time increased steadily 
with age, being 24 minutes for patients aged 15 to 
44 and 48 minutes for patients aged 65 and over. 
There were diagnostic differences in ease of ad- 
mission; for example, coronary heart disease cases 
were easy to admit, irrespective of age, and, in 
general, surgical cases were easier to admit than 
medical. 

Within the hospital, alternative deployment 
of beds is usually a matter of administrative action 
rather than of controlled experiment. But discus- 
sion in relation to "progressive patient care" and 
"intensive patient care" is causing considerable in- 
terest and speculation at present. These systems 
of care are difficult to apply in hospitals with the 
British system of the small independent clinical 
unit of 30 to 60 beds, and uneconomic to operate 
without some more centralized system of admis- 
sions. Experimental studies are planned in a 
number of hospitals. 
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Jeffery and Burr (03) from the Oxford 
Regional Bonrd Research Unit arc attempting to 
construct a theoretical model to describe the nurs- 
ing care of a surgical patient during his stay. 
Their object is to assist in selecting a time for the 
discharge of the patient, in normal circumstances. 
The relationship of the lime chosen to the patient's 
degree of independence can he more clearly seen, 
and so the choice o f time is less blind. The stay 
in hospital for surgical treatment is divided into 
three stages: admission to operation; heavy or 
medium nursing care; light or domestic care. 
Nursing care is categorized into skilled, intermedi- 
ate and domestic levels for each nursing duty, and 
each component is timed and graded. This is the 
first step in a plan of work to clarify inpatient use 
of hospital facilities in operational research terms. 

Planning new hospitals involves for us a 
move away from the old Nightingale wards, and 
guidance is needed to decide how many single-bed 
rooms should be provided. Goodall and Bailey 
{84) of the Nuffield Trust team made a study to 
determine what proportion of beds in a ward 
should reasonably bo provided in single rooms to 
satisfy the medical needs of the patients. After 
reference to a number of physicians, a list was 
compiled of 31 conditions qualifying patients for 
accommodation in single rooms, and it was used 
by interns in 29 wards of 8 general hospitals to 
record each day over a period of a month whether 
the patients in the ward qualified for single rooms. 
From an analysis of these records, conclusions 
could bo drawn about the most desirable provision 
of single rooms (desirable in the sense that statis- 
tical prediction showed a high provision figure 
with a high usage figure.) . 

Bailey cites the example of policies of early 
nmbulation lo point out that changing medical 
fashion or technique in treatment is one of the 
most difficult things to allow for in ward design. 
The Nuffield group also made studies in ward de- 
sign based on the principle of compactness in 
terms of the nurse's movements. 

Newell (3i)) has tackled the problem of esti- 
mating the appropriate provision of emergency 
beds in hospitals by testing a simple mathematical 
model against hospital data. He found that any 
scheme for the provision of emergency beds must 
take into account seasonal differences, including 
in particular any difference in the demand pattern 
on Sundays as compared with weekdays. When 
this is done, it is shown that for average daily 



demands of between 5 and 30 beds, 2 more beds 
than the average daily demand should he provided 
to ensure a bed immediately for 95 percent of 
emergency cases, 

EFFICIENCY IN USE OF SPACE 
AND EQUIPMENT. As the hospital becomes 
more and more mechanized, requiring increasingly 
expensive technical plant and manpower, so it be- 
comes more important to ensure maximum pro- 
ductivity. It is only recently, however, that the 
hospital service in the U.K. has been seriously in- 
fluenced by the kind of approach and techniques 
commonly used in industry. But significant 
changes have taken place. 

It is difficult, in talking about this aspect 
of the work, to draw any hard and fast line be- 
tween operational research on the one hand and 
work study and the procedures of organization 
anc| method on the other. Techniques of "opera- 
tional research," developed during wartime to im- 
prove prediction in aerial bombardment and other 
military situations, have been adapted to health 
service problems, introducing to them the use of 
statistical models. Such procedures quantify the 
results of existing procedures and possible modi- 
fications, thus permitting the administrator to 
judge more clearly the consequences of alternative 
courses of action. They have been used to exam- 
ine such matters as ward design, outpatient ap- 
pointment systems, and effective demand for hos- 
pital beds. 

Other techniques, commonly called work 
study and organization and method, have been 
transplanted from industry. Numerous hospital 
activities have been investigated by work-study 
methods, ranging from kitchens and the deploy- 
ment of domestic staff to the work of outpatient 
departments, The techniques used are the analysis 
and timing of activities so that they may be de- 
scribed quantitatively to permit rational consid- 
eration of possibilities of more effective deploy- 
ment. 

Similar attention has been paid to functions 
within the hospital with the aim of achieving 
more efficient hospital design and layout of com- 
ponent parts. For this purpose useful partner- 
ships have been formed of different professional 
skills, for example, the architect, the work study 
expert, the statistician, the nurse, and the doctor. 
The procedure, known as "organization and meth- 
od" or business efficiency examinations, has been 
used in hospital and local health authority services 



to scrutinize staff activities and methods of record- 
kceping find design. 

It can now be assumed that these investiga- 
tive procedures have fully just ified themselves and 
have come to stay. My only criticism is that, in 
unskilled hands, they are at best useless and at 
worst dangerous, the clangor lying- principally in 
the risk of drawing conclusions from inadequate 
knowledge of the sif nation. What we must do now 
is recruit, train, and expose to medical care situa- 
tions more people of the necessary calibre to in- 
crease the amount of investigation so that it can 
become a built-in feature of the service; and we 
must finance research groups to carry the tech- 
niques to fresh problems so that methods can be cle- 
voloped to extend the range of activity of the per- 
manent investigative groups. 

As a working definition in the context of 
this paper, I will not refer to work-study proce- 
dures which are now essentially of a routine 
nature, but will describe as operational research 
only work which hashud more general application. 
A further note about the organization of work 
study in the service may be of interest, however. 

In 1954, to find how useful management 
efficiency techniques would be in hospital adminis- 
tration, the Ministry of Health (36) provided 
the hospital authorities with the services of a team 
of investigators. Their work, reinforced by the 
results of independent experiments made by Ox- 
ford and Manchester Regional Hospital Boards 
and "Westminster Hospital, demonstrated that 
systematic study of the mechanics of running a 
hospital usually achieved more economical use 
of resources and improved services. The Ministry 
decided, therefore, that such work, essentially a 
matter of management, ought to bo developed as 
an integral part of the hospital service, with its 
techniques modified io meet the special needs of 
hospital patients. Toward this objective, steps 
were taken between 1958 and 1960. The National 
Health Service Advisory Council for Management 
Efficiency was set up and senior & M and work- 
study experts were appointed by Regional Hos- 
pital Boards and Boards of Governors, Today all 
Regional Hospital Boards and most teaching hos- 
pitals have such staff. 

The Ministry's & M Unit*, enlarged and 
made permanent, has a key position in the plan 

* The subjects of the Unit's pilot and special studies 
include : hospital secretarial, clerical, domestic, phar- 
maceutical, and malnteuance services; the departments 



to encourage investigation in the hospital services 
and is responsible for conducting pilot studies on 
subjects useful to the hospital service and pub- 
lishing summarized reports of them. It also col- 
lects and distributes information on efficient 
methods and efficiency studies completed and in 
progress, and arranges meetings where & M 
and work-study officers can pool experience. In 
addition the Unit undertakes special studies for 
Regional Hospital Boards, Boards of Governors 
and the Ministry itself, 

Bailey has made notable contributions to 
this field, and he discusses theoretical aspects of 
some of the work in a number of papers ( 37) . For 
example, he deals with developing appointment 
systems in outpatient departments, with general 
problems relating to internal traffic, with studies 
in the hospital and ward layout, and with the 
problem of assessing the efficiency of single-room 
provision in hospital wards, which has already 
been referred to. 

The Nuffield Provincial Hospitals Trust (8) 
played a notable part in developing the research 
aspects of this kind of work. Often their studies 
have shown the way for a more routine approach 
through the Ministry's own organization. I have 
already referred to the exhaustive examination 
they made in 1955 of the hospital, its functions 
and design. A more recent example of their work 
in this field is a study by Brigadier Welch of the 
organization of diagnostic X-ray departments 
(38). 

The post-war increase in the intricacy and 
volume of X-ray investigations has outstripped 
the resources of most departments. This expan- 
sion in complexity and demand has not been 
balanced by a similar expansion in hospital de- 
velopment. The present trend in the hospital 
service towards providing more outpatient facili- 
ties, with the aim of seeing and treating more pa- 
tients in less time, has further increased the X-ray 
department's difficulties. It is not surprising, 
then, that many are badly arranged and difficult 
to organize and run economically. 

The Nuffield Report is based on a 3-week 
investigation of diagnostic departments in a group 
of six hospitals, which included a market town, a 
large provincial, and two teaching hospitals. All 

of pathology, physiotherapy, and diagnostic X-ray ; nurs- 
ing ; outpatient waiting time ; costing ; chest clinics. It 
has also studied B.B.B, organization, A.D.P. equipment, 
and the ambulance service. 



were found to be far from ideal, so poorly accom- 
modated as to make organization difficult, and 
working, on the whole, in comparative isolation 
from other associated departments of the hospital. 
Faulty techniques were identified, both in the hos- 
pital and in the departments, to explain this. The 
reaction of the radiology departments to these de- 
fects tended to be a reluctance to meet some re- 
quests even though genuinely urgent. The flow of 
patients was considered, and it was discovered that 
the two peak periods making difficulties for the 
departments were largely created by the system of 
bookings used. The waiting time for patients was 
examined and procedures discovered to lessen it. 
Careful observation showed that less than 50 per- 
cent of the radiographer's time was actually em- 
ployed in radiographic or closely related work. 
Similarly, radiographic rooms were used for less 
than half their available time, even in the busiest 
departments. 

EFFICIENCY IN MANPOWER USE. 
This section should really be called : "Research to 
improve the use of womanpower," since much the 
greatest body of relevant research done in the 
United Kingdom has been devoted to the study of 
nursing needs, training, and deployment. This 
may be surprising, but it is true. Nursing activity 
in hospital was one of the first fields to be investi- 
gated, with the acute shortage of professional 
nurses acting as a drive toward the discovery of 
ways and means to better use the available re- 
sources. "Work-study procedures were used to de- 
scribe as precisely as possible the work done by the 
nurse and highlight those aspects of her work 
which might be delegated to less skilled people. 
Similar studies have indicated deficiencies in the 
training of the student nurse and set in motion 
various experiements to achieve improvement. 

In fact, there is probably just ns much need 
to study, in the same way, the relationship of med- 
ical manpower to the hospital, but almost nothing 
has been done in this connection which could truly 
be described as research. Sundry reports have 
dealt with aspects of the profession, but these have 
been more or less on traditional lines as far as 
methods of collecting information are concerned. 
The Report of the Platt Committee (39) dealt 
specifically with hospital shilling, particularly 
numbers of consultants and specialists and the 
appropriate proportion of trainees for the consul- 
tant posts. It drew attention to grave discrepan- 
cies between the strength of consultant and trainee 



consultant posts and more junior grades in the 
hospital service and made recommendations on the 
general practitioner's position in the hospital. A 
good many problems amenable to operational study 
can be seen behind the discussion and recommenda- 
tions of the Committee, but no plans have been 
made for such work so far as I know. Certainly 
the medical staff, as much as any other factor in 
the hospital situation, deserves attention by opera- 
tional methods to achieve optimum usage of time 
and skills. Work done in the planning of ap- 
point ment systems for outpatient departments 
(37) is an example of this kind of desirable activ- 
ity, since it involved better planning of the 
consultant's time. 

Attention has been called to problems sim- 
ilar to those so well publicized for the nursing pro- 
fession of the misuse of skilled personnel, whose 
time may be token up by work which could easily 
be performed by less highly trained people. This 
is eminently the kind of problem suitable for op- 
erational and work study. An example of tlus 
kind of misuse was mentioned previously of X-ray 
departments, where the radiographer was found to 
be spending less than 50 percent of his/her time 
upon professional activities. The list of projects 
undertaken or proposed in the field of work study 
indicates that, to some extent, this kind of activity 
is being taken care of by the hospital service work- 
study units. 

EFFICIENCY OF THE HOSPITAL 
AS A SYSTEM. "Hospitals have come fairly 
rapidly through a revolutionary period of reorien- 
tation of functions. Broadly speaking, the func- 
tion of hospital organization in the past was to 
provide premises and nursing service for the in- 
dividual physician or surgeon to do his work. To- 
day, technological development and the growth of 
knowledge, which have made increasing specializa- 
tion necessary, make for increasing interdepend- 
ence of personnel and dependence of all upon com- 
mon service departments. Formerly, each unit 
could perhaps be its own therapeutic community; 
today, if there is a therapeutic community at all, it 
has to be the hospital as a whole. 

"The large question in hospital service to- 
day is directed towards this last point. To what 
extent lias interdependence been accepted in any- 
thing except a technical sense? How far is the 
hospital community functioning, in fact, as a- com- 
mon enterprise with commonly accepted goals 1 
The question could, of course, be widened still 
further : how far is the hospital functioning with 
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other parts of the health service towards mutually 
acceptable objectives?'* (11) 

We are dealing here with questions of ad- 
ministration in an enlarged, expanding, complex 
field of interrelation ships. On this inherently very 
difficult, and extremely important subject, the only 
ma-j or work in progress is that of Professor Revans 
(40) nnct his colleagues from Manchester. He has 
attempted to examine some problems by trans- 
lating certain concepts from industrial sociology 
to the hospital field. He has used labor turnover, 
sickness absence, and accident rates among the 
nursing staff of hospitals as indicators of greater 
or lesser coherence within the organization of the 
hospitals concerned. For example, in one hospital 
group he studied, where the nurses* training was 
divided into 3-month periods spent- alternately in 
the large parent hospital and smaller satellite hos- 
pitals, he has shown that the sickness absence is 
systematically more frequent in spells and longer 
in duration when the girls are in the parent hos- 
pital. This, he suggests, is because the girls have 
greater difficulty in perceiving intelligibility in 
their work in the much larger mother hospital. 
"Life in the mother hospitals seems to be less in- 
telligible because the student feels more alienated. 
The lack of intelligibility in times of crisis lends 
to strain; strain leads to physical breakdown. 
This process is accelerated when strain or anxiety 
is unrelieved by the emotional support of a senior 
or more responsible person." 

Tn another group of hospitals, Professor 
"Revans* team was invited to study the wastage 
rates of student nurses. Near Manchester five 
acute, general hospitals of equal size were chosen 
in towns similar in economic status and social 
ecology. The records wore examined for a period 
of fi years and the hospitals ranked in order of 
student- nurse wastage rate; i.e., the rate at which 
nurses left before completing their 1 training. He 
then studied the wastage of other staff members, 
including matrons, ward sisters, staff nurses, as- 
sistant nurses, and domestics. He found the pat- 
tern of wastage similar in all staff grades and the 
ranking of the hospitals for wastage rates was 
closely correlated across the grades. Revans post- 
ailated that these high wastage rates arose from 
a defect inherent in the hospital communications 
system, probably affecting all communications in- 
cluding that between nursing staff and doctors and 
all hospital activities including care of the pa- 
tients. To examine this hypothesis, he studied the 

96 



duration of stay for certain diagnostic categories 
in these hospitals and showed that on average it 
was consistently greater in the hospitals with the 
high wastage rates. 

His team has also studied 18 large, acute, non- 
teaching hospitals outside London, using the ward 
sister (head nurse of the ward unit) as an indi- 
cator of the communications system within the 
hospital. The ward sisters were interviewed and 
their attitudes to subordinates and superiors rated 
on a scale for perception and understanding of 
problems. The hospitals were ranked according 
to the average rank order of perceptiveness of the 
sisters and examined for the statistics of staff sta- 
bility and duration of patient stay. It was found 
that staff stability was greatest and patient dura- 
tion of stay shortest in those hospitals character- 
ized by a high level of perceptiveness among the 
sisters. 

From all this evidence, Revans (41) postu- 
lates a factor of transparency/opaqueness in the 
communications system for which size of hospital 
is less than 50 percent responsible, the major com- 
ponent being some element indigenous to that par- 
ticular hospital. He believes that whatever it is 
that determines the degree of transparency/ 
opaqueness, it probably runs through the whole 
hospital system, and may well stem from the top 
echelons of management and administrative and 
medical staff. 

Revans (42) now wishes to explore in more 
detail this postulated quality of transparency/ 
opaqueness. He plans to do so in an experimental 
situation where he will be closely concerned with 
a, hospital organization as investigator and thera- 
pist. His plan is to attempt to delineate the prob- 
lems and to test their existence in a therapeutic 
problem-solving situation. He is already orga- 
nized to start the next stage of his work in a large 
hospital in Birmingham with the support of the 
Nuflield Provincial Hospitals Trust. 

In the general field the only other study which 
I will mention is one carried out by Sofer, a so- 
ciologist, as part of the work of the Acton Trust 
team. The Acton Trust studies, although not re- 
search in the normally accepted sense, are valuable 
systematic examinations of the administrative dy- 
namics of tlio National Health Service made by 
independent" investigators using observational and 
narrative techniques. 

Sofer, using informal interview and case-study 
approaches, considered three hospitals in the 



period 1952-1954; that is, comparatively soon 
after the, changeover to the National Health Serv- 
ice. To focus more clearly on the impact of 
change, he concentrated on the changing author- 
ity, responsibilities, and status of the three chief 
officers in each case the heads of the medical, 
nursing, and administrative services. 

In each hospital studied, incorporation into 
the new national service had meant a different 
thing to the staff. Its impact and implications 
had varied according to earlier relationships with, 
external authority, the previous internal structure 
i of the unit, and the specific changes which the 
new system had imposed on that structure. Sofer 
found two sets of problems : first, those inherent 
in the working of large-scale organizations (such 
as centralization and decentralization and the fit- 
ting of specialists into the general framework of 
administrative organization) ; and second, those 
arising from the transfer to a national hospital 
service. 

The term "therapeutic community," used 
earlier in this section, is the concept of a medical- 
care institution such as the hospital having some 
corporate therapeutic aspect in addition to any 
specific therapy laid down in the regime of the 
individual patient. Despite the importance of the 
concept if it is valid little or no work has been 
done to study it except in the field of psychiatry. 
Maxwell Jones (44), the psychiatrist who popu- 
larized the term, has given it a controversial spe- 
cial connotation of his own. His experiment in 
the Belmont Hospital was not controlled research 
but work in the nature of a case demonstration 
of how to turn the whole focus of an institution, 
and all members of it, both staff and patients, into 
active participants and contributors to a thera- 
peutic situation. 



Research on Hospital Services Designed To 
Limit the Use of Beds 

This is a most interesting field of work con- 
taining for investigation two main problems aris- 
ing from the present division of medical labor and 
responsibility in Britain. First is the need to 
find the best method of providing for ambulant 
and semi-ambulant patients the technical re- 
sources which can only be made available in hos- 



pitals. The British hospital service has had to 
adjust itself without a major building program 
to a situation where medical hotel-keeping is the 
lesser part of its work in terms of the numbers of 
patients investigated. It is scarcely surprising 
that this drastic shift in workload without ac- 
companying physical planning has led to a good 
deal of stress and strain. Second is the need for 
a better definition of the shared responsibility of 
hospital and general practitioner. 

So a number of studies have been carried 
out or are'in progress surveying the boundaries of 
care provision which lie between the hospital and 
the domiciliary services. The hospital outpatient 
department is an obvious area for study. Let me 
remind you of the simple mechanics of the situa- 
tion. Hospitals arrange a variety of general and 
special clinics or consulting services, at which 
patients are seen by specialists and their junior 
staff, and often the patients will be referred for 
further investigations by the laboratory, X-ray, 
and other departments. Patients may be seen on 
an appointment system, and this practice is in- 
creasing ; but there are still many clinics to which 
the patients come without specific appointments. 
By long-established professional custom, now em- 
bodied in Health Service regulations, patients 
other than casuals are scon by consultants only 
if referred by i general practitioner : so they have 
been through one medical screen before coming 
to hospital. The field forces of attraction are com- 
plex. Clearly there are certain kinds of expertise 
and technology which can only be made available 
on our definitions by the hospital. But other pa- 
tients may be sent by the general practitioner 
simply because there is some kind of examination 
(e.g., laboratory or radiological) which he can- 
not carry out himself but which he is perfectly 
competent to assess. 

Increasingly the hospitals are allowing the 
general practitioner to use these facilities without 
requiring him to refer his patient to another doc- 
tor before the test can be authorized; it then be- 
comes a, matter of interest to discover which gen 
eral practitioners avail themselves of these direci 
access facilities (45). The question of incentives 
or their lack, enters into the equation in varying 
degree but to an unknown extent. There is no 
financial incentive to the general practitioner to 
keep his patient away from hospital this may be 
good. On the other hand there may be a kind of 
incentive (since he gets paid the same amount any- 
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way) to get rid of a troublesome patient by send- 
ing him to hospitaland this may be bad. 

USE OF OUTPATIENT FACILI- 
TIES.- Plainly, from our point of view, this situ- 
ation merits study: study to identify the charac- 
teristics, medical and otherwise, and the needs of 
this largo and much increased group of patients; 
study to try to understand better the dynamics of 
the relationship between hospital and general 
practitioner. We want to know such things as: 
how many patients there are from a given popula- 
tion; their diagnoses by age and sex; their treat- 
ment; how many were admitted a? inpatients ; how 
often they attended the outpatient clinic; who saw 
them there; what medical benefit, they derived 
from their attendance; how long they had to wait 
for an appointment; how long they had to wait at 
the clinic to be seen by a doctor; who was the gen- 
eral practitioner; how many patients he refers to 
hospitals in a year compared with other general 
practitioners; what kind of case report he sent 
with the patient to explain his reason for the re- 
ferral ; what kind of report the hospital sent to 
him ; does he think the hospital helped his patient ; 
does he think the hospital held on to his patient 
'oo long. 

Barr (46), from the Oxford Regional 
Board, has made- a substantial beginning in this 
field. He notes that, including "casualties," some 
13 million new outpatients were seen during 1959 
in England and Wales, making over 40 million at- 
tendances. The number of inpatients treated in 
the same period was 4 million, so that new out- 
patients outnumbered inpatients by some 3 to 1, 
while the ratio of outpatient attendances to in- 
patients was some 13 to 1. Related to population, 
his means that one person in every four attended 
he outpatient department each year (but this fig- 
ire may be exaggerated by the statistics). 

Slightly fewer than half of the new patients 
fctended "casualty" departments, 

From the evidence, the volume of outpatient 

-ork appears to bo increasing. In the decade 

}50-1959 the total number of new outpatient re- 

irrals (excluding casualties) increased by some 

o percent. In the same period, discharges from 

lospital increased by 27 percent. Coupled with 

he growth in volume has been a marked expansion 

n the range of outpatient techniques and treat- 

nents. 

The Oxford Unit made a 3-month factfind- 
ng inquiry of certain outpatient departments in 



Reading based on information collected routinely 
in the case notes. The study was thought of as a 
reconnaissance to supplement the scanty knowl- 
edge of the Board and to prepare the way for 
further investigation. 

The annual outpatient referral rate for 
Reading was established at 69 per 1,000 popula- 
tion. About one-quarter of the patients visited 
the clinic once only; one-half attended three or 
more times, and one-quarter attended at least five 
times. For patients with multiple attendances, the 
average period of time over which the visits were 
spread was 6 months. 

One-third of the patients were referred to 
one or more of such services as pathology, radi- 
ology, physiotherapy. One-fifth were referred to 
more than one specialty. About one in seven pa- 
tients had to wait 5 or more weeks for an out- 
patient appointment; over one-quarter of the 
sample were admitted to hospital. After treat- 
ment as outpatients or as outpatients and inpa- 
tients, 60.6 percent were discharged as requiring no 
further medical care. Approximately 12 percent 
were referred to the general practitioner with spe- 
cific treatment recommended; 2 percent, were re- 
ferred with an opinion only ; 3.8 percent were sent 
to another hospital ; 8.5 percent ceased to attend the 
clinic of their own accord. 

The amount of referral by different general 
practitioners varied widely but was not correlated 
with either the size of practice or the doctor's age. 
The proportion of patients referred who were ad- 
mitted as inpatients was used as a very crude esti- 
mate of the general practitioner's acuity. Of the 
outpatients, about one-quarter were admitted. For 
different general practitioners the proportion 
varied from under one-tenth to nearly one-half. 

Barr and the Oxford Unit are continuing to 
work in this field. He wishes to clarify the true 
role of the hospital in outpatient work, and thinks 
that looking more closely at the spectrum of at- 
tendance will be useful. A careful appreciation of 
the single attendance cases might indicate: what 
circumstances really require these patients to at- 
tend the hospital; how many might have been 
diagnosed and treated solely by the general prac- 
titioner given better services to supplement his 
clinical assessment. Other basic questions are: 
can the resources which the general practitioner 
needs bo provided by the hospital service either in 
terms of facilities or postgraduate education ? For 
the patient who attends over a long period, can 



better methods of working together by hospital and 
general practitioner be devised? Such methods 
would presuppose greatly improved communica- 
tions between the hospital and the outside doctor. 
Can delay in obtaining an outpatient appointment 
be drastically reduced ? 

ROLE OF THE GENERAL PRACTI- 
TIONER. A more difficult, yet fundamental, 
problem is what motivates the general practitioner 
to send a patient to hospital. The quick answer is 
to obtain a diagnosis, advice, and treatment; but 
this leaves unexplained wide differences in referral 
rates between doctors, If the only reason for re- 
ferral was to obtain diagnosis or treatment, then 
one would expect the proportion of patients, 
standardized for age and sex, not to fluctuate be- 
tween doctors by more than the limits of chance. 
This does not hold good. Doctors differ widely 
in the number of patients they refer to hospital 
and a study of this particular aspect is essential 
to the fuller understanding of the basic demand 
for hospital facilities. 

Barr suggests two further matters for 
study: The increased use of outpatient depart- 
ments for preliminary investigation of patients 
to be admitted to hospital; and the possibility of 
permitting the general practitioner direct access 
to hospital waiting lists for certain conditions, 
e.g., hernia requiring operating. 

Priest (4-7), a hospital clinician, reviewed 
his case notes of 1,000 consecutive outpatients re- 
ferred to n general medical clinic in a medium- 
sized, provincial, non-teaching hospital. He, too, 
noted the wide range of referral rates among gen- 
eral practitioners, and observed a markedly higher 
referral rate among urban as compared with rural 
practitioners; he states that "the influence of easy 
access to hospital is evident." 

In Guys Hospital, Acheson, Barker, and 
Butterfield (48) made a study of general practi- 
tioner uso of outpatient services by looking at the 
choice preferences of practitioners in an area con- 
taining several hospitals to which the practitioner 
may send his patients. The biggest factor deter- 
mining the doctor's decision was the patient's own 
preference. The patients' preference tended to- 
ward the teaching hospital, but the practitioners' 
toward the non-teaching hospital because it was 
more cooperative and offered direct access to diag- 
nostic services. "Although, in the area studied 
there is little personal relationship between family 
doctors and hospital staff, it is clear from the an- 



swers . . . that there is in many practices a 

to establish such a relationship." The Guy 

pita! group are making further intensive : 

of the outpatient service of their own he 

Fry (49) examined the use of the oufcj 

department from the standpoint of a genera 

titioner by analyzing his own referrals to lie 

throughout a year. Out of a practice of 5,5 

tients, which is the responsibility of two d( 

7.5 percent were referred during the year t 

pital; of these, 3,7 percent were admitted as 

tients, 3.8 percent as outpatients. In addit 

percent were sent direct for radiology, and ' 

cent for pathologic investigation. Pie cone 

that the three main reasons why the general 

titioner refers patients to hospital are : for cor 

investigation requiring special skills and ap 

tus; for a second opinion when the general p 

tioner is unable to reach a diagnosis; for treaf 

beyond the means of the general practitioner i 

ing in his consulting rooms or in the pat 

home. 

A number of other studies are in pro; 
Logan and Foray th (50) of Manchester are 
ing a study of outpatient services in 20 areas t< 
cover the range of problems and methods. Ba 
(51) in Aberdeen is studying the nature and e 
of contact between the practitioners in the n 
east of Scotland and the hospitals which 
them, with a view to delineating the factors T 
determine the doctor's use of the hospital. 

Scott, Gilmore, and I are making a ! 
of Edinburgh outpatient services and the paf 
of general practitioner usage of them. 

CASUALTY SERVICE. The specif 
tion of the outpatient service called the Cus 
Service has mixed origins, being original! 
direct access service for ambulant patients wh 
no general practitioner, as well as the rece 
area for injuries and the treatment area f( 
juries not requiring admission. The latter 
tions are its primary concern in the eyes c 
Health Service, but the old direct access pa 
have continued to leak into it around the 
of the general practitioner service. It is \ 
recognized to be the Cinderella service of tb 
pital understaffed, underprivileged, and 
worked. Recently fairy godmothers have, 
to examine its needs and plead its cause. 

Mestitz (52) discussed a group of 
"medical" casualty patients seen, at the Mid 
Hospital in London. In 27 percent, no c 



ause of the patient's complaint could be identified. 
j. Fry (5ft) analyzed 5,000 attendances at a South 
Cast London hospital casualty department. Sixty 
lercent were new attendances, of which nearly two- 
hirds were made by casual attenders not referred 
iy a practitioner. Only one-half of these new 
mtients were trauma cases. In that hospital the 
.nnnal number of new casuals had doubled over 
he previous 12 years, despite the fact that every- 
>ody now has a general practitioner. He con- 
ilucles : "The present-day casualty department has 
10 specific function and runs as a 'general prac- 
ice.' It is misused to a considerable extent both 
)y the public and by their doctors !" 

A 5-month survey of all Portsmouth's (54) 
:asualty services showed that a mass of trivial ma- 
;erial was dealt with, and tit least one-quarter of 
;he cases should have been seen and treated by their 
general practitioner. The reduction of pressure 
>n the casualty department would then allow the 
.imited hospital staff to do its proper job effec- 
tively. 

Blackwell (65) in an interesting paper re- 
viewed the work of the casualty department at 
Gruys Hospital, which has continued to some ex- 
:ont its traditional function as the neighborhood 
factor. He concluded that nearly one-third of 
"hose attending the department instead of their 
)wn doctor did so for social or psychological as 
ivoll as medical reasons. More than half the "un- 
necessary attendances" were in this group. 

Although in 1958 there were in England 
ind Wales some 11 million casualty attendances, 
i central or regional policy on (his part of the hos- 
pital service was slill lacking. The Nuffield Pro- 
incial Hospitals Trust (56) decided to attack the 
iroblem using its own method of study. They de- 
med desirable criteria of provision and a rating 
icale for each main element of the service (e.g., 
nodical staffing, nursing staffing, accommodations, 
quipment, patient comfort, records, control of 
ifection, rehabilitation, and resettlement). 

A team with expert surgical members vis- 
ted each department in the study and rated each 
ilement on the scale, They found wide variations 
n standards with severe deficiencies at the lower 
ind of the scale and many anomalies in the use of 
.his part in relation to other parts of the National 
Health Service. A substantial number of recom- 
ciendations were made. That such criticisms are 
iffective is shown by the publication in 1961 by 
he Department of Health for Scotland (57) of 



its report on Provision and Design of Casualty 
and Accident Departments, based on careful in- 
vestigations made in a number of casualty centers 
by the Hospital Development Unit and Work 
Study Group of the Department. 

Future trends in the outpatient service will 
be for the more trivial activities to wither and die, 
and for some of the major activities to develop 
into the concept of the day hospital. There have 
been interesting experiments in day hospital pro- 
vision particularly in the geriatric field but, as yet, 
no serious evaluation has been made. The report 
of Stephens and Dudley (58) on outpatient sur- 
gery for hernia cases suggests that the day hospital 
concept may develop for the acute sick also. Night 
hospitals in the psychiatric field, and 5-day hospi- 
tals which shut down at the weekend to solve staff- 
ing problems, are other experiments envisaged in 
the effort to break away from the hotel -hospital 
concept. 



Research on Medical-Care Services To Keep 
Patients Out of Hospital 

There are two reasons for being interested 
in this question: one is the economic reason al- 
ready discussed. The economic argument seems 
logical in reference to most kinds of acute sickness. 
Tho costs of providing and maintaining a high- 
standard bed are so great that only good medical 
reasons can justify its use. But the same argu- 
ment does not necessarily hold good in the field of 
chronic and mental illness. Along the potential 
scale of provision of domiciliary support, there 
must come a point where in sheer economic terms 
it is cheaper to centralize costs in an institution 
than to provide everything for one patient in his 
home. What sometimes appears as economy may 
simply be transfer of cost to someone else. What 
is apt to be forgotten in the equation is the eco- 
nomic loss of the wage earner who stays at home 
to look after the invalid. 

The other reason for interest is the propo- 
sition to which most people would subscribe that 
hospitals are good places to keep out of anyway. 
In other words, ambulatory medical care, other 
things being equal, is better medical care. This 
may sound absurdly platitudinous to you, but I 
believe it is a statement worth repeating in the 
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U.K., for we show strong tendencies to under- 
nourish our domiciliary relative to our hospital 
services. 

If words mean anything, the general practi- 
tioner as the center of the domiciliary care service 
ought to be the key figure in o ur Health Service. In 
fact, he is not, but it is difficult to assess the change 
in his position since 1948. We had in the early days 
of the service the survey reports of Ceilings, Had- 
field, and Taylor (45) casting light into some dark 
corners of our general practitioner service. Since 
then a striking interest has arisen in the well-being 
of general practice, of which the College of Gen- 
eral Practice founded 10 years ago is at once a 
symptom and a cause. In this sense there is 
marked improvement. But of technical advance 
in general practice there is little sign and for the 
simple reason that we have not yet found a means 
within our terms of reference to bring about an 
industrial revolution for the general practitioner. 
The Health Center was intended to provide this 
grouping and technical support, but the idea has 
not yet got off the ground. The general practi- 
tioner is excluded from the hospital, so he 
continues to operate at cottage-industry level, un- 
derfinanced in terms of capital equipment and 
auxiliary support. At the same time a deep and 
widespread feeling exists that the personal rela- 
tionship and responsibility for continuity of care 
which our system of general practice permits is 
something worth preserving. Our task is to rec- 
oncile the social advantages of general practice 
with technical advance. Until we do this, our 
services outside the hospital will be below the po- 
tential of which they are capable, and will con- 
tinually require support from the hospital to com- 
pensate for this. 

RESEARCH ON GENERAL PRAC- 
TICE. In response to the challenge in this situa- 
tion, there has been a great revival of interest in 
research based on general practice. The General 
Register Office, with its great General Practice 
Morbidity inquiries, has given the lead, while the 
College of General Practice has followed and the 
Medical Research Council has set up a General 
Practice Research Committee. Most of this re- 
search, however, is concerned with epidemiology 
and control trials, and failure to develop opera- 
tional studies from within general practice is sig- 
nificant. There is within the Health Service no in- 
centive to efficiency studies in general practice, 
equivalent to the economic forces driving the hos- 



pital service in that direction. Nor is there an 
administrative unit within the general practice 
set-up able to initiate the necessary action. Each 
general practitioner is an individual entrepreneur 
in contract with his local Executive Council. 
Cottage industry does not breed operational 
research. 

It is not surprising then to find that the 
pressure slowly building up to force us to look 
again much more carefully at the work and or- 
ganization of general practice is coming from the 
hospital. It is the pressure to keep patients out 
of hospital which will gradually lead to a reassess- 
ment of the domicilary services. In the meantime 
the operational studies developing at the out- 
patient department and other boundary marks of 
the hospital are all potentially just as much studies 
of general practice as of hospitals. 

EFFECTIVENESS OF HOSPITAL 
TREATMENT. Preventing the return of the 
hospital patient after discharge is an aspect of 
keeping people out of hospital which has received 
some attention in the U.K. "We have no true pic- 
ture of the extent of readmission, but we have 
plenty of glimpses which suggest that it must be 
a large component of hospitalization. By and / 
large, there is a curious lack of interest in assessing 
the effectiveness of hospital treatment. No doubt 
many hospital admissions are sufficiently grave to 
appear justified in terms of the short-term result. 
The hospital structure itself, too, tends to foster a 
short-term view. When the patient disappears 
through the door with "cured" or "improved" or 
"stablized" written on his record, that may appear 
to be the final verdict, because the patient is lost to 
view. But the true situation may be quite dif- 
ferent. 

Followup studies can be a simple, if im- 
precise, method of keeping some kind of sense of 
perspective on the results of hospital treatment. 
They may shatter complacency. 

lu 1945, Brown and Car-ling (59) reported 
from Professor Witt's unit in Oxford on 150 con- 
secutive patients followed up 12 to 18 months after 
discharge from a general medical ward in a teach- 
ing hospital. Only 26 percent of the patients had 
been cured, though 48 percent had returned to 
full-time work and 20 percent were doing part- 
time work. Four years later there was another 
report from the same unit (60). In the interval 
an almoner (medicosocial worker) had joined the 
team and they hoped to he able to judge whether 
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his had improved results. This time 38 percent 
rero judged to have been cured, 37 percent were 
till suffering from the disease which had caused 
dmission, 17 percent were dead. On the other 
iand, 60 percent had returned to full-time work, 
nd only 6.5 percent were unable to follow their 
isiml employment. In 1949, Pemberton and Smith 
'61) undertook a study in Sheffield to discover to 
vhat extent male patients aged 50-64 admitted to 
he general medical and surgical wards of a teach- 
ng hospital were subsequently able to return to 
vork. They were followed up for an average of 
I months after discharge from hospital. Thirty- 
hree percent of the medical and 59 p&rcent of the 
nirgical patients were back at their former work; 
}8 percent of the medical and 15 percent of the 
surgical patients had died in hospital or before the 
'ollowup. 

In 1954, Ferguson and MacPhail (62) in 
Glasgow published their report on 705 men dis- 
charged from medical wards of a teaching hos- 
pital in Glasgow and followed up for 2 years. At 
he end of 2 years, 171 were dead ; 129 had had one 
)r more spells of hospital treatment since their dis- 
jharge. Of 474 interviewed at home, 111 were 
judged to be cured ; 195 had continued to improve; 
L06 were still far from well; 64 had deteriorated; 
L06 had not worked since leaving hospital; BO had 
worked for less than one of the two years. The 
worst results were seen among the unskilled labor- 
ers in the lowest socioeconomic groups. 

A sequel to this study was published last 
rear (63). The survey was extended beyond 
/rlnsgow to find whether the poor results pre- 
viously discovered were repeated elsewhere and 
studies along similar but not identical lines were 
nade in Dundee and Aberdeen. In Glasgow, in 
vddition to the followup, a deliberate attempt was 
nade, by providing an advisory aftercare service 
for the discharged patients, to improve results, 
tberdeen^ a much less industrialized city with a 
onsiderable catchment area of rural population, 
LEid somewhat better results than the other centers 
iut, broadly speaking, the same gloomy picture 
vas again revealed, The advisory aftercare serv- 
ce provided 5n Glasgow seemed to have made lit- 
le or no difference to results. Ferguson reported 
hat the Glasgow study makes it clear that, valu- 
able as they may be for short-term aid, the social 
iervices at present available will not greatly affect 
he results of hospital care. He states, however, 



that better social and rehabilitation services might 
lead to improvement. 



Looking at the System as a Whole 

We have made a little progress in extend- 
ing our knowledge of facets of our hospital serv- 
ice, but we are far from finding techniques for 
examining its functions as a system. Experi- 
ments proposed or in progress to use computer 
techniques and record linkage studies are a step in 
this direction. For example, a pilot project has 
been started in Oxford to test the feasibility of 
linking together records of births, confinements, 
hospital discharges, and deaths on and after Jan- 
uary 1, 1962. At present, manual and IBM sort- 
ing is used. It is intended, if the pilot study 
proves successful, to process the data on electronic 
tape (64). 

In the meantime, perhaps the simplest way 
of assessing what happens within our complex sys- 
tems of medical care is to ask the consumer. The 
patient in the hospital bed is in a sense at the 
center of one network of the system and may be a 
useful informant, on many aspects of hospital 
functioning. 

McGhee (65) made an interesting study 
based on interviews with patients before and after 
discharge from hospital. Her intention was to 
throw light upon nursing care as seen through the 
eyes of the patient. But, in fact, insights were 
gained into many aspects of the hospital's work. 
The patient proved to be surprisingly tolerant of 
hospital discomforts, but there seemed to be fail- 
ures of communication in the matter of giving him 
real understanding of his condition and his future 
needs and behavior in relation to it. 

A similar but, smaller study has been pro- 
duced from Manchester (66). 

The Institute of Community Studies (67) 
in London is at present carrying out a question- 
naire and interview study to examine the relation- 
ships (particularly the communications) between 
patients, hospitals, and general practitioners with- 
in the Health Service as a whole. The technique 
employed was a postal canvass of a population 
sample of 29,000 to identify among them those who 
had been patients in hospital during the previous 6 
months: 739 persons who had been patients were 
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interviewed. In addition, a sample of 124 general 
practitioners gave their views on the relationship 
between general practitioners and hospitals. Pre- 
liminary reports on the study suggest again that 
failure to communicate adequately with the 
patients is often one of the shortcomings of the 
system. 

P.E.P. (Political and Economic Planning) 
(68), a research group concerned with a wide 
variety of social issues, has just published a report 
on Family Needs and the Social Services, the re- 
sult of a survey to find out the feelings and opin- 
ions of people about the Health and Social 
Services. The sample is not representative of the 
whole country but only of the Greater London 
area and interviews were confined to families with 
children under 16. An interesting, if inevitably 
sketchy, picture emerges on a very large canvas in 
which the Health Service is clenrly shown as by 
far the most used and appreciated of the social 
services. There are criticisms, but not many. 
Certainly not enough, for surely the best hope for 
the future well-being of the Service is an intelli- 
gently critical public and a profession willing to 
educate the public on the right points to criticize. 

THE CHAIRMAN: 

I thank yon very much, Dr. Brotherston. 
It is exactly the review we had hoped to be possible 
and you did have a tremendous amount of ground 
to cover. I appreciate all the preparation that 
must have been behind it, in spite of your familiar- 
ity with what was going on in the various investi- 
gative areas. 

I would now like to call on Dr. Davies for 
some comments. 



A New Look at Hospitals m Great Britain 

DR. J. 0. F. DAVIES: 

Mr. Chairman, I was very full of admiration 
yesterday of the way in which the various groups 
of speakers interdigitated themselves. My task 
is to complement what Prof. Brotherston has said ; 
I have jotted down a few notes and I propose to 
speak to them. 

At the moment, I am on loan to the Ministry 
of Health. This important department has, over 
tile last few years, undergone a very substantial 



change. It has a now chief medical officer, a new 
permanent secretary, a new minister, and there is a 
new look ojbout the department. 

We now have a 10-year hospital building 
program and we are about to abandon the previous 
practice of the Department on Hospitals of criti- 
cally examining plans and making comments on 
them. The picture has now changed and we have 
taken a leaf out of the book of the Department of 
Health and Welfare and we produce guide ma- 
terial. This guide material sets out the beat ac- 
cepted practice. It is sent in draft form to all our 
regional hospital boards, who can comment and 
influence the final draft. After completion, this 
is nevertheless still guide material and nobody is 
expected to adhere to it meticulously. However, 
they are expected to keep within cost limits unless 
they have good reasons for doing otherwise. 

People can still come up with new ideas and, 
of course, it is important that they should be able 
to do that. 

Having produced the guide material, the 
officers of the Ministry have informal discussions 
with those who have a hospital project in hand. 
When those informal discussions result in an agree- 
ment, provided the costs are reasonable, the hos- 
pital authority can then get on with the job. 
Therefore, although the Department still does 
exert a fair amount of influence, which it should, 
since it is a kind of repository of experts, the 
regional boards are very much on their own in- 
sofar as actual construction is concerned. 

Now, this 10-year plan, so-called, isn't a 10- 
year plan it is a rolling plan for every 10 years 
and it is, in fact, subject to review annually. If 
there is doubt on the part of anybody that the 
hospital plans are not going to function in the 
way forecast, then these points are made known at 
the annual review when the main plan may be re- 
vised. 

CONSIDERING THE PATIENT. Our 
Minister has been tremendously keen, in our hos- 
pitalization, to introduce and accentuate what he 
calls the "human element" and he has taken a very 
great deal of trouble himself to push various fac- 
tors in relation to the operation of the hospital 
such as the reorganization of the inpatient day, 
so that the patient isn't wakened at dawn and isn't 
sent to bed very early and is treated in kindly fash- 
ion in these matters. Two other matters have 
been "noise in hospitals" and human relations in 
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jbstetrics on which the Minister received a report 
Tom one of his advisory committees. 

The Minister has a keen interest, in patients 
lot wailing for long periods in outpatient depart - 
nents, and currently we are studying the appoint- 
nent, systems that hospitals use. You will he 
mi-prised how inefficient some hospitals can be in 
levising appointment systems. When cursorily 
axamincd one can tell right -from the very start 
Jiafc the patient at the end of the list, is going to 
lave a long waiting period. We have ideas about 
ippointment systems which get the patient to the 
specialist in a reasonable time. 

We have also in the Department a small 
Troup fostering management studies. Professor 
Brotherston has mentioned the Acton Society. 
This group was highly critical of the Department 
in that it did not have an "intelligence" section, a 
section that brought together knowledge, distilled 
it, uaid put the information back to hospitals. The 
Department does now have the embryo of such a 
section and it will bo responsible for initiating and 
catalyzing a number of studies. 

The Ministry now intends to set aside a sum 
of money to foster research into management, and 
other operations. It may seem strange to you that 
n, department which dispenses about eight hundred 
million pounds annually does not keep back half a 
million for itself and, indeed, from the first of 
April next, they will have a very small sum to fos- 
ter mainly operational research experiments. 

There are a number of studies going on in 
Lhe organization relative to management of hos- 
pitals. Practically every department in a hospital 
operates in a way different from that which is 
supposed. The more studies there are, the more 
it is seen that what actually goes on differs in 
some ways from what is intended. The more 
studies that lead intention to action the bettor. 

MANAGEMENT SURVEYS. In Eng- 
land we plan to define responsibility for hospital 
management a little better than has been done in 
the past. There are regional hospital boards and, 
below them, committees of management. The 
committees of management are, in fact, legal en- 
tities in their own right, and there has been a lack 
af definition as to who does what. It is hoped that 
better management will result from a survey of 
this field. 

T7 - M i e attempting to provide training in 
and to assure that our management 
gularly will have certain information 



before them at their meetings. These voluntarily 
serving members will be what you would call 
trustees of your hospital. Our aim is to attempt 
to interest them by providing them with informa- 
tion as to how workloads are being dealt with, how 
they are assessed, and to give them opportunities 
to devise means of ascertaining if their resources 
are in fact employed to the best advantage; how 
their performance should be judged, and how they 
can compare it with that of others; and how they 
should be looking ahead in relation to forward 
planning in a, management sense. 

The department will also bo collecting new 
ideas, assessing them and, if need be, carrying out 
"organization and method" experiments or sur- 
veys, either directly or by persuading the regional 
hospital board or management committee to do it 
as agent. 

Of course, this may strike you as being very 
simple, but it is a part of our new look because 
wo have not done this before. 

We shall also aim to try to establish norms 
of good practice. These are, of course, very diffi- 
cult in some ways to define though easy to recog- 
nize. Our hope is that we shall be able to provide 
si number of factors that will enable hospital man- 
agement to be carried out much more efficiently 
than we believe it to be at the moment. 

Having done all this, we hope to have a 
rather better follownp system. We will have our 
regional hospital boards supporting our commit- 
tees on management in their attempts to run the 
hospital more efficiently, 

BED USE. One of the departmental 
studies includes n look at a half-dozen hospitals, 
to see how they use their beds. A small team in 
the Department, with the collaboration of the hos- 
pitals, will spend a few days in the hospitals find- 
ing out just what goes on, which we hope will serve 
a very useful function. 

Some simple questions as to what arrange- 
ments there were for keeping beds used under re- 
view, and what information they used showed 
that their statistics were not always of high qual- 
ity. Of the six hospitals, two of them thought 
that they had good statistical systems, but they 
were loo complicated for the trustees of the hos- 
pital to understand. Our aim here would be to 
attempt to devise a simple form that will provide 
sensible information -which the trustees can look at 
month after month and then ask questions about 
what is going on. 



One of the other questions was on the real- 
location of beds, as between disciplines, to meet 
varied demands. And I believe that our some- 
what rigid allocation of beds to our specialists is in 
some ways one of the worst features. If we could 
have a situation in which we had allocated X beds 
to a specialist with a lease, as it were, on Y beds, 
we would have a very much more flexible system 
which would enable us to deal with situations more 
expeditiously. At the moment there is a certain 
amount of bed exchange, of course. If one group 
gets hard pressed, they borrow beds from others. 
There is also a certain amount of seasonal 
exchange. This is something that, within the 
total, should make bed allocation very much more 
flexible. 

This same little study inquired into the pro- 
cedure for dealing with emergencies, which must 
be admitted to hospital. It was quite obvious that 
there were a number of hospitals over-insuring 
against the number of likely emergencies. A rec- 
ord, over a period of time, can allow one to predict 
what the pattern is going to be. If the number of 
beds left empty is accurately related to emergency 
needs, then beds will not be left empty which can 
be used for treatment. 

Other studies have shown that patients were 
being admitted well in advance of the day for op- 
eration or, alternatively, if coming in for investi- 
gation, without, the arrangement for the investiga- 
tion having previously been worked out. This 
meant that the patient might well be occupying a 
bed for no useful purpose. The promotion of 
techniques whereby this amount of wastage does 
not come about is the same as providing more beds. 
One of the serious problems for a- hospital 
is the patients for whom nothing further can be 
done, who come into the category of the chronic 
sick patient. Acute beds may be blocked by in- 
ability to discharge these patients. This is quite 
a problem, particularly in the case of an accident 
ward with a large number of fractures of the femur 
in old women. We do have a problem in this area, 
and in some parts of the country the care of the 
chronic sick is well- organized. However, I should 
be misleading you if I led you to believe that every 
area was of a high standard. The adequacy of the 
care of the chronic or aged sick patient depends 
upon the dynamic policies of the physician in 
charge of the unit, on his ability to do battle with 
his clinical colleagues, because most clinicians who 
look after the patients in acute beds really do not 



have much interest in the patient when he or she 
becomes geriatric. I see relatively little future for 
geriatric departments unless they are in the care 
of a man who regards this as his life's work and 
is prepared to put aH his energies into it and to 
do battle with regional hospital boards, the com- 
mittees of management, his colleagues, the whole 
lot, to get the things he wants. Under these dy- 
namic. circumstances, patients get rehabilitated and 
often discharged home and a good service is ren- 
dered. In England arid Wales 80 percent of the 
aged sick are in their own homes. The hospital 
service needs to treat the remaining 20 percent in 
hospital. It does become a problem if movement 
of patients fails to occur. If it is possible to make 
a light shift to home care> the problem is eased. 

One individual I know is doing a very good 
job along this line. He undertakes to share the 
responsibilities with the relatives and lie will 
readily readmit patients in any social or medical 
crisis, whatever it is. He takes the critical factor 
out of the situation within 24 hours, and with this 
kind of assurance relatives begin to cope with their 
old folk in an entirely different way. As you 
know, wo have a home care service provided by 
general practitioners and. by local authorities, as 
a result of which, we are better able to look after 
these people. The secret of keeping some of these 
old patients out of hospital is shared responsibil- 
ity, sharing with the family, supported by domi- 
ciliary services. 

The local authorities in England and Wales 
are developing a 10-year plan which will shortly 
be published, showing how their medical care serv- 
ices will be expanded. This, it is hoped, will 
complement the hospital plan and enable better 
use to be made of hospital beds. 

DURATION OF STAY. Now, one of the 
things that I have been interested in is duration 
of stay in the hospital. It seems to me this is abso- 
lutely critical. We have always been impressed 
with the short duration of stay you have in your 
hospitals. Of course, whether you keep the pa- 
tients for 10 or 15 days does make a tremendous 
difference in the number of beds you require. Sur- 
geons vary widely in England and Wales in their 
ideas of average duration of stay. A group of six 
at ona hospital recently sought the help of a statis- 
tician who asked their opinion. One of them gave 
a figure of 9 days, another 12, another 15, the 
fourth said about 18, and the fifth said 21. This 
was for the same class of patients. Now, it is very 
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ifficult under those circumstances to know what 
le right thing to do is, and so this statistician 
lite wisely settled on about 13. 

I am now trying a new study in which we 
Eive a dozen surgeons treating 1 a hundred patients 
iffering from a comparable condition to find out 
recisely what happened to them, and, as a result, 
hope to show some marked differences. The 
kelihood is that the patient with the short dum- 
on of stay has done no less well than others but 
lis needs to be demonstrated. One can then only 
ape that it will act as a challenge to those sur- 
ions who wanf more beds than they now have. 
ho regions with relatively few acute or short- 
rm beds have much shorter average durations of 
ny than the hospital regions which are more gen- 
ously supplied. My particular region, which is 
is Oxford region, does have, in fact, less beds 
tan some of the other regions. Our average 
iration of stay, therefore, as you can expect, is 
sry much shorter, I am personally quite con- 
need that duration of stay is a function of beds 
'ailable. 

HOSPITAL SIZE. Our now hospital 
an involves the provision of quite large hospitals. 
r e aim to provide with a good general hospital, a 
srintrio service and a psychiatric service. This 
>cs not. mean that we are going to house all geri- 
ric and psychiatric patients at the main hospital 
:e, but we will have a fair percentage of them. 
)me of the fairly long-term geriatric patients 
ay require to be out in an annex. There are 
mnd to he some long-term psychiatric patients 
10 will not be dealt with in the general hospitals. 
le intention is, however, to put psychiatry 
xigside general medicine. Wo think that gen- 
al medicine will learn a lot from psychiatry. 
ley have been divorced and separated much too 

lg " 

This likewise means that our hospitals are 

ing to be sizeable. We have not set any limits 
size. For a population of 150,000 people we 
3 likely to require a hospital of from GOO to 800 
:ls. There will be larger hospitals serving 
ger populations. The intention is to develop 
r outpatient departments and make them really 
ective instruments. We intend to build them 
lerousl y. We propose to give them all the tech- 
:al facilities they require. We propose to give 
im what we call day beds to which the patient 
i be admitted for the day or night for investi- 
;ion desired that day. If the surgeon desires to 



do outpatient surgery, lie can do it and have a bed 
available for the patient to rest before going home 
the same day. 

We have one or two very outstanding ex- 
amples of outpatient surgery. Farquharson of 
Edinburgh has, in the last 8 years, done 4,000 
operations on patients with hernia or varicose 
veins needing stripping and sent them home the 
same day. He has, however, not been emulated 
by any large number of people in Great Britain, 
though many keep their patients for one or two 
days only. It is interesting to note that of a series 
of Aberdeen patients operated on by Stephens and 
Dudley who were first asked whether they desired 
to bo operated on as inpatients or outpatients, 
nearly a.11 said they would prefer to be operated on 
as outpatients. This meant they were operated on 
and sent home on the same day. No complications 
or untoward result came from this series of cases. 

QUALITY OF CARE. There is just one 
other point that I would like to touch on and that 
is something that was raised this morning. One 
of the speakers was talking about collective con- 
trol as being likely to result in improvement in 
quality of surgery. This was, of course, a prob- 
lem which we were faced with when the National 
Health Service came into being. We did have 
general practitioners undertaking surgery which 
was not, of the quality that you would expect from 
consultants in (Koir field. By consultants, I mean 
a Fellow of the Royal College of Surgeons o f Eng- 
land and who, in addition to this, also had 6 or 
more years of training. This does mean that all 
of our consultants are of a high standard at the 
time we appoint them. 

In the early days of the Service we did put 
an end to a good deal of the general practitioner's 
surgery and, as you know, there was a cry to the 
effect that wo had thrown the general practition- 
ers out of the hospitals. Very many of our gen- 
eral practitioners continue to work in the hospitals 
and I think in the next few years more will work 
th&re than ever before, in such capacity as they 
may bo trained for. However, the point is that 
wo acted as the instigators of collective control. 
Any general practitioner who undertakes surgical 
procedures in the Health Service now, and some 
do, does it now on the responsibility of the con- 
sultant surgeon. I think the quality of our medi- 
cal service is the better for it. 

In quality of care, we have not done very 
much in the way of studies, but we have our ears to 



the ground and we have been terribly interested in 
some of the studies going on over here. I am hop- 
ing that within the next few years ive can catalyze 
a number of qualitative studies in our country also. 

DISCUSSION 

THE CHAIRMAN: 

Both you and Dr. Brotherston, from what 
you have reported^ are far too modest in the 
amount of research going on in your country. 
Are there any questions? 

MR. FTTCHS: 

I would like to pursue a line of questioning 
that I opened up with Dr. Brotherston before. 
This refers to the demand for hospital and health 
services and the economics of the term demand. 

It is a matter of observation that different 
people like to spend their incomes in different 
ways. Some people will spend more for motor 
cars, some more for television sets, whiskey, food, 
or what have you. The thing I am wondering 
about in the hospital and medical service described 
is this. Is there a provision for those people who 
want to spend more of their income for better 
medical care or hospital services to do so? Has 
there been any research done to determine what 
the extent of the demand might be, or has there 
been a policy decision made that everyone should 
get the same care and quality of medical care re- 
gardless of how they want to allocate their income? 

DR. DAVIES: 

I think I had better take this one. 

All of the hospitals have private beds and 
there is nothing to prevent the patient entering a 
private bed and paying for his care, selecting the 
surgeon on whom ho wants to depend. The ordi- 
nary nonprivate patient cannot select his surgeon. 
He may be sent by his general practitioner to a 
particular surgeon who may well see him and 
operate upon him. But the operation may be car- 
ried out by another member of the surgical team in 
the case of the ordinary patient, on the responsi- 
bility of the consultant. As a private patient, 
however, one can enter into a contract with a par- 
ticular surgeon and pay him directly. 

As to the extent of use oi private rooms, wo 
find that their low occupancy is a controversial 
point with the administration. A hospital, when 



it is short on emergency beds, can always put a 
patient into a private room without charge, Were 
it not for the fact that this could be done, the 
occupancy rate would be still worse. 

DR. BROTHERSTON; 

I have one comment. I think you can take 
it that our concept of private medicine is that the 
patient is purchasing an amenity, not quality of 
care. We would not like to think in the Health 
Service that you can purchase better surgery by 
being a private patient. You can, however, pur- 
chase more frequent visits from the relatives, and 
you can purchase some privileges and that kind of 
thing. 

MR. McNERNEY: 

Have you looked into whether the surgeon 
attending a private patient comes up with the same 
diagnosis sis the one attending a general patient 
and whether private patients who have a contract 
with the physician receive similar services to other 
persons with the same or similar diagnoses? 

DR.DAVIES: 

Well, if I understand your question, I can 
say we have not made such a study. However, if 
we did, I think we would find that the private pa- 
tients might possibly be in for a shorter duration of 
stay but, on the other hand> the cost of the hospital 
might well be expensive too. 

REPRESENTATIVE : 

In other words, these beds are not used 
strictly for private patients but they are also used 
for very difficult cases ? 

DR. DA VIES: 

They are,not used for very difficult cases. 
They are only thrown into use in an emergency. 
That is to say, if the hospital is full and they have 
no bed to house a patient t then they use the private 
accommodation. The difficulty of the case does not 
determine whether the patient goes into a private 
bed or into a general ward. 

REPRESENTATIVE : 

Some of us heard Dr. Bailey apeak this 
summer at the California Department of Public 
Health. Ho described the occupancy studies that 
you mentioned and pointed out that occupancy was 
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a function of duration of stay and turnover time, 
and he used a figure of 2 days as the average turn- 
over period between occupancies. This seemed 
to all of us to hurt him very much. These were 
in connection with hospitals where the waiting 
lists were about equal to the number of beds. Well, 
upon return from California, I made comparable 
studies at Johns Hopkins University and found 
about 2 hours to be the turnover time. Could you 
any anything about this question of 2 days, as to 
why this occurs? 

DR. BROTHERSTQN: 

Well, we have one hospital with a shortage 
of nurses which is working on a 5-day week basis. 
This hospital, in fact, is operating very efficiently. 
We also find that hospitals are tending not to have 
patients in over the weekend if they can avoid it. 
We have to rely, to a considerable extent, upon 
part-time married nurses and they like their week- 
ends with their husbands. Therefore, we have a 
difficulty here. Therefore, if one admits the pa- 
tient on Monday and leaves Sunday empty, then, 
in fact, it isn't an inefficient use of hospital beds. 
After all, you have to feed the patient, However, 
I must admit that here and there an inefficient 
management does result in the turnover intervals. 
From time to time, when we especially are visiting 
a hospital, say twice a week, we aim to try to gel 
people working on a more solid contract than these 
two half-days a week. In some of these cases, if 
the surgeon insists on seeing the patient himself, 
then there is a kind of wastage as to time. How- 
ever, not all occupancy or long-turnover in inter- 
vals is inefficient. 

THE CHAIRMAN: 

You mentioned the 10 percent sample in the 
collection of data. Did you cover the detail? 
What sort of statistics were being collected from 
that sample in your paper? 

DR. BROTHERSTON": 

Yes, I have said something aboiit this. 
From the start, this hospital inpatient question- 
naire or inquiry was envisioned ns having two 
functions. One was a division of morbidity data 
and the other was to assess hospital administra- 
tion. Therefore, the data give you diagnosis, size 
of hospital, region, duration of stay, etc. The re- 
sponses supply quite a sizeable amount of ex- 



tremely interesting data about the workings of the 
hospital and, as the survey goes on, more tabula- 
tions will be produced of this kind. 

DR. PAYNE: 

You had mentioned that general practition- 
ers usually provided their continuity of care under 
the system. I wonder if it is possible or whether 
it is done for specialists also to provide continu- 
ity of care in sucli diseases as diabetes or heart 
disease? 

DR. BROTHERSTOrT: 

Yes, this is in fact very much so. There is 
a tendency, with certain kinds of medical condi- 
tions, primarily for hospital specialist groups, to 
build up outpatient services with which patients 
may be associated over a long period of time in 
such conditions as diabetes, stabilization of anti- 
coagulants, and coronary disease, for example. 
There is no doubt that this has provided a very 
valuable service. We have evidence which shows 
the value of this in diabetes. However, equally, 
at the margins, there is an area of conflict here 
between the hospital and the general practitioner, 
as the hospital may tend to hold onto the outpa- 
tient longer than the general practitioner thinks 
it necessary. There is also a problem that, so long 
as the hospital takes over responsibilities of this 
kind as it wore, the general practitioner's capacity 
for coping with this particular problem is eroded. 
However, this is a sort of responsibility which is 
amenable to quantitative study. I think it is a 
question of the technology involved and the skills 
involved in providing the supervision and care. 
Also on a population basis, it is unlikely that any 
one general practitioner would have the number 
of such patients required for him to build up the 
skills to give the care which these conditions need. 

DR. PAYtfE: 

One other question. It was said that length 
of stay was a function of available beds and, of 
course, this has been debated for a long time. 
Superficially, the difference between your country 
and ours as to length of stay is very much a matter 
of custom. It is customary in Michigan for ob- 
stetrical patients to stay 4 days. In England it is 
customary for these patients to stay 10 days. In 
Canada, right across the river from Detroit, the 
length of stay in acute myocardial infarction is 6 
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weeks in Michigan it is 3 weeks. This is 
customary. 

DR. DAVIES: 

I say there are different customs when you 
live in different parts of our country also. I would 
also someday like to conduct a study in order to 
find out which group of patients really does best 
in the long run, 

DR. BROTHERSTON; 

Perhaps certain types of customs, like cer- 
tain kinds of traditions, are involved. I think 
your duration of stay for maternity cases was 
pretty sharply changed during wartime so that, 
after all, there are factors in this situation other 
than just local tribal custom. 

THE CHAIRMAN: 

I think it is also true that on the West Coast, 
where stay seems somewhat lower, there has also 
been a great population growth and shortage of 
beds. Therefore, there is a certain relationship. 
I suppose wo all get to wondering what would 
happen if one had endless beds. 

MR. DENSEN: 

I would like to go back to the comment that 
Dr. Brotherston made a moment ago in relation to 
Dr. Payne's question. Yon mentioned the value of 
the hospital specialist, in certain programs, taking 
care of patients on a longer outpatient basis, and 
said that the value of this lias been shown in 
diabetes. Would you elaborate what the items 
were that showed the value of this arrangement 
in regard to diabetes? The reason I ask this ques- 
tion is that it is of interest in the measurement of 
the problem of quality of care discussed earlier 
this morning. 

DR. BROTHERSTON : 

Well, my memory is hazy on this, but this 
is in terms of such things as different types of 
patients, frequency of comas and hyperanemias, 
or more serologic complications, in groups con- 
trolled at clinics as compared with groups in the 
hospital. 

DR. BARSAMIAN: 

I was just admiring this book of Dr. Broth- 
erston's with regard to the problem of length of 



stay and number of admissions. The appendix 
shows the differences in length of stay of surgical 
patients. You have explained this as 60 percent 
medical and 40 percent surgical. Doing a bit of 
arithmetic, you find the length of stay with those 
factors, times the number of admissions per thou- 
sand population, divided by the number of beds 
per thousand population between us and England 
comes out to exactly identical %ures ? which really 
shows that progress is supplied in terms of 
demand. 

JSEPBESENTATIVE : 

I notice a lot of footnotes and references in 
the paper, and I wonder if these will be supplied. 
I would like to have these references. 

DR. BROTHERSTON: 

I think you can take it that the reference 
numbers are written in because of our hope that 
something will happen. 

REPRESENTATIVE : 

"Would you say something about the size of 
hospitals, if you. can, and whether all hospitals 
have the common specialty services such as mater- 
nity and pediatrics? 

DR. DAVIES: 

As I so-icl, we expect all of our hospitals to 
be general hospitals and to have obstetric and 
pediatric departments ; likewise a geriatric depart- 
ment and a psychiatric department. Some of them 
will have full-scale accident departments. One of 
the things that came out of what was said this 
morning had to do with casualty departments. 
Tlie Kuffield Trust sponsored a study of casualty 
departments, accident or emergency rooms, and, 
as a result, we have had two quite good reports 
produced, one by the Department and one by the 
British Medical Association. We intend to aban- 
don a large number of the accident departments 
that we have and we likewise intend to provide 
24-hour coverage in. others. Also, we intend to pro- 
vide a higher quality of medical supervision than 
we have ever had before. 

Casualty departments, although they are a 
hospital shopwindow, are not the responsibility of 
any consultant surgeon. The intention is to give 
one consultant an administrative responsibility in 
this field. The implication of all this is that the 
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lospitals will be big hospitals and it seems to me 
.hat they can be anything from 500 beds 'to what- 
ever the top limit in a given case is likely to be. 

One of the things we do not intend to do is 
mild smaller hospitals. Our feeling is that the 
;eneral hospital should not have less than 300 
>eds. It has to be able to carry the necessary con- 
nltant services of one general hospital. If these 
.ervices are provided for every small little hos- 
lital, there would not be enough skilled personnel. 
Dhorefore, the fact is that our hospital level, the 
owest level, is likely to be in the nature of 300 and 
he upper limit has not been determined. 

DE. BEOTHEESTON: 

I would just like to add one comment to this 
iccident business. 

Oddly enough, one of the few studies that 
ms been made in my country in the general field 
tf medical care study goes back into time and was 
n the field of trauma. Before the war there was 
t fracture committee. I think it was the profes- 
iion itself that did this. The British Medical As- 
iociation, if I remember rightly, set up a study on 
he outcome of fracture treatment in terms of time 
aken for bone union, time taken for restoration of 
'unction, time taken before the man went back to 
vork, and this kind of thing. It compared results 
iinong the specialists, the orthopedic clinics, the 
general surgical clinics, and surgery by the general 
mictitioner. Differences were found in favor of 
he specialist and, further, the orthopedic units 
vero better than the general surgical units, and the 
jeneral surgical units were better than the general 
iractitioner care. This report has a very great 
nfluencG in the thinking in my country about how 
ractuves should be treated, and I think it also 
IBS influence in. terms of the view of responsibilities 
iy the lower courts. If a patient, brings action 
or damages against a physician, this kind of 
vidence might be used to show that the particular 
diysician should not have attempted to look after 
hat case. This is an additional kind of discipline 
/hich was brought about. 

ME. J. C. WOOSLEY: 

I would like to point out that this matter 
f optimum hospital size must be very much a 
unction of demographic factors too. The distri- 
ution of population in Great Britain is outside of 
lie large metropolitan areas and is probably a 



great deal more uniform and dense than it is in this 
country. It would certainly point to the possibil- 
ity that in other situations, such as in parts of this 
country where population is spread much more 
evenly, you simply have to get along with smaller 
hospitals. Isn't this true? 

DR. DA VIES : 

We accept the fact that from time to time 
we have to build smaller hospitals, but they can- 
not support, the kind of medicine that wo feel hos- 
pital treatment implies. We must make some pro- 
vision for really isolated communities. As I say, 
we will have to make some special arrangements. 
However, the principle from which we move is 
clearly laid down, 

REPRESENTATIVE : 

One of the things that bothers me a little 
bit is that the admission of the patient to the hos- 
pital as obviously under the control of the physi- 
cian and, in this country, with the hospital care 
becoming more centered on hospitals, we admit 
that we also have the increasing trend' toward spe- 
cialization. I understand that in the United King- 
dom admission of patients to the hospital is on the 
recommendation of the general practitioner 
through a consultant on the staff of the hospital. I 
wonder if you would have any concern about hos- 
pital utilization if more and more general practi- 
tioners had hospital privileges so that you would 
get circumstances more parallel to what exists in 
this country ? 

DE. DA VIES: 

I think it is likely that more and more of the 
general practitioners will work in hospitals. 
Whether in fact they will be taking in patients or 
just working*!!! hospitals is one of the things that 
remains to be seen. At the moment, the general 
practitioner is fhe man who triggers the whole 
thing off, He determines that he cannot any 
longer look after his patient at home for studies 
lie wants to make and, therefore, hospitalization is 
required. He is the man, in fact, who gets in 
touch with the consultant and arranges the ad- 
mission. 

REPRESENTATIVE: 

Does he not have to persuade the consultant 
that the patient should come to the hospital or 
does he fling the patient on the consultant? 
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DR. DAVIES: 

In the case of a geriatric patient, he inflicts 
the patient. In the case of the others, he has on 
the whole very little difficulty persuading the con- 
sultant. 



THE CHAIRMAN: 

TVe do appreciate Dr. Broth ersfcon and Dr. 
Davies being willing to prepare this material for 
us. It has been most worthwhile and very help- 
fill. It is also vety pleasant to visit with them. 
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WEDNESDAY AFTERNOON SESSION 
January 23, 1963 



The meeting was reconvened at 1:40 p.m., 
Mr. Bugbee presiding. 

CHAIRMAN BUGBEE: 

I don't need to introduce most of the panel. 
I mentioned to you that Dr. Nelson had been called 
home and that Dr. Trussell had to leave yesterday. 
Added to the panel and not shown on your list is 
Dr. Willard Wright, who is on the Council of the 
American Medical Association. He is a practic- 
ing surgeon and he is a very good member of the 
committee which developed the report on "Area- 
wide Planning for Hospitals and Related Health 
Facilities" by the Joint Committee of the Ameri- 
can Hospital Association and the Public Health 
Service. 

You have already met Dr. Brotherston, Mr. 
Dp.nsen. Walter McNerney, and Dr. White. 



George St. J. Perrott you all know. He 
was, for many years, a member of the staff of the 
U.S. Public Health Service and very much in- 
volved in the collection of data and research in 
medical care throughout a long career. He is 
presently acting director of the Division of Re- 
search and Statistics of the Group Health Associa- 
tion and is involved in some studies for that or- 
ganization. 

The subject of the panel is not an easy one, 
and I believe that they would be delighted to have 
you join in with comments and also to be ready to 
ask questions. They are going to direct their 
initial comments toward approaches to further 
research on hospital use and its related aspects. 

We thought that Dr. Brotherston had 
earned a slight respite and so wo are going to call 
on him a bit later. I would like to suggest that 
we start with Paul Densen. 



GUIDELINES FOR FUTURE RESEARCH 



Mr. PAUL DENSER: 

It seems to me that the discussions in the 
last two days and one of the things that is fairly 
evident is that the factors affecting hospital utili- 
zation are largely forces that operate in the com- 
munity outside the hospital. 

If you wish, therefore, to influence the uti- 
lization of the hospital, you must take account of 
the relationship of the hospital to the community. 

We have, in New York City, been giving 
considerable thought to this from many different 
standpoints, and particularly from the standpoint 
of some of the issues relating to the quality of 
medical care. Everyone is concerned with trying 
to provide some form of high quality medical care 



which encompasses such things as continuity, 
comprehensiveness, and family-centered care, but 
nobody is quite sure how you do this kind of thing 
or what kind of situation lends itself best to pro- 
ducing this kind of care. 



Experimental Situations 

In the Health Department in New York 
City, we felt that, since we were in this relatively 
ignorant position, one approach would be to try 
to set up experimental situations, in -which we set 
up different kinds of approaches to providing the 
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medical care and then looked at what happened to 
patients and to their utilization of medical care 
facilities in these different situations. I would 
like to take a moment to describe briefly some ex- 
amples of what I am talking about. I do this be- 
cause I think that this offers one kind of approach 
to the problem of looking at the community fac- 
tors influencing the utilization of the hospital. 

One of the situations which it has been pos- 
sible for us to set up in New York has to do with 
the welfare population. Our welfare population 
in New York City gets its medical care in the 
usual way, through a panel physician type of 
arrangement. The program is such -that tho pa- 
tient must call a physician to the patient's home 
and so obviously the home-call rate in this land 
of situation is extremely high. It seemed desirable 
to try another approach, and the approach used 
was developed with New York Hospital. 

At New York Hospital, 1,000 welfare fam- 
ilies are provided with complete medical care in 
the hospital, in the home, in the outpatient depart- 
ment and, if necessary, in the nursing home. 
There is a control group of another 1,000 welfare 
families drawn exactly the same way from the files 
of the welfare department. In fact, the 2,000 fam- 
ilies are randomized as to who goes into the welfare 
project at New York Hospital and who gets medi- 
cal care in the same way they usually tlo. 

I won't go into the details and methodology, 
but these two groups are being compared in terms 
of such things as their utilization of medical facil- 
ities, their visits to outpatient services, their rate 
of hospitalization, and the costs involved. 

One of the interesting side products of this 
particular piece of research is the fact that the 
hospital now knows more than it ever knew before 
about what it costs to take a patient into the hos- 
pital and what it costs to take a patient into the 
outpatient department, because in order to make 
the comparison, they had to know what was going 
to be included in the cost factors. I think it was 
very surprising to some of the hospital adminis- 
trators to discover that they did not know as much 
as they thought they did about the costs of patient 
care in the hospital. 

The third area in which the two groups are 
going to be compared has to do with the thing 
that was talked about to some degree this morning, 
the quality of medical care. There we are wres- 
tling, just as you all were this morning, with what 



is meant by quality medical care, and to some di 
gree they are turning in the direction that ws 
suggested this morning and yesterday afternooi 
of looking at the "so- what" type of study. 

This is not the only approach that they at 
taking. It is also combined with the approac 
that Dr. Peterson mentioned yesterday, as well a 
some of the others, which is a medical-audit typ 
of approach. 

The New York Hospital experiment is on 
approach to looking at utilization. And whei 
you set the situation up experimentally, you havi 
some degree of control over it. 

If I may go back for j nst a moment, I woulc 
like to reiterate that the forces influencing hospita 
utilization are largely outside of the hospital. You 
might wonder, perhaps, how it happens that the 
hospital is even interested in listening to the health 
department in the development of demonstrations. 
Well, this comes about partly because of popula- 
tion changes in terms of numbers and partly be- 
cause of the economics of the situation. One of 
the reasons they are interested in listening to differ- 
ent kinds of arrangements is that they are losing 
teaching material because of changes in. tho pro- 
portion of the population covered by health and 
hospital insurance and changes in population coin- 
position around the hospitals. The proposed dem- 
onstrations provide a mechanism by which they 
can get teaching material in a way that hasn't been 
available to them before. 

HOSPITAL-HEALTH CENTER CO- 
OPEKA'flON. Another situation which we 
have organized in New York City grows out of the 
fact that one of the hospitals in New York City 
happens to be a few blocks away from the district 
health center. In the St. Luke's Plospital pro 
gram, the district health center and the hospita 
work very closely together. This is not a nsia 
idea it has been tried in other places, but here wi 
are attempting to develop it on a large scale. 

One of the things that has already hap 
pened is that the well-baby clinics that were i*iu 
for two afternoons a week in the hospital hav 
been placed in the district health center. Th 
health department pays the hospital's staff plrj 
sicians as well as its own physicians for the cfli 
they render. The quality of the care is supervis 
jointly by the pediatrics department in this tea< 
ing hospital and by the health department. 

I can remember a few fragmentary figui 
from the early part of this. The program, hasi 



gone very far at this point. The well-baby clinic 
referred 44 babies to the hospital for more defini- 
fcivo care than could be rendered at clinic because 
(hoy were ill. Every one of those 44 showed up at 
the hospil al and they all had a note that went back 
to the district health center about what was found 
in the hospital. This i s quite different from what 
happens in most of our baby clinics. It gives you 
an example of ways in which we might play 
around with developing continuity of care. 

Of course, it still begs the question as to 
what about (ho impact of this on the health of the 
baby. This question poses some very difficult 
measurement problems, but I think that we have 
< o put our minds to it and find a way to solve them. 

HEALTH CARE FOR THE AGED. 
Now, very quickly, I would like to go to the other 
end of the age scale and talk about our Queens- 
bridge project. This is jusfc another experimental 
situation. In this particular program we are 
working in a housing situation which involves a 
high proportion of aged individuals. Further, in 
Now York City terms, it is fairly far removed 
from the hospital. By this I mean that it takes 
about three-quarters of an hour and several buses 
for these elderly people to get from the housing 
project to the municipal hospital, which is the 
only one available to most of them. Further, 
their income status is exceedingly low. 

The district health officer and the housing 
people were very much concerned about the health 
of this group of elderly people. It was decided to 
set up a kind of an outpatient clinic right in the 
housing project. We have done this. It is a com- 
bined program of the health department, housing 
department, hospital department, the welfare de- 
partment, and I think there are a few other de- 
parlmonts also involved. I do not say this face- 
tiously, because I think it is important to recog- 
nize the fact that when we start to work on these 
problems we pretty soon have to find a way of 
approaching the problem as a problem and not 
worrying about who has departmental jurisdic- 
iion. We have to find ways of crossing depart- 
mental lines. There are organizational patterns 
in New York City, such as the Interdepartmental 
Health Council, which are designed to do jusfc this. 
That, of course, is at the top level. 

However, at the level where you see the 
patients, this operates even more forcibly, I 
would like to give you just one example with re- 



gard to the Queensbridge Housing Project to in- 
dicate just how this works. 

It had been unheard of in New York City 
to allow the patient's record to leave the hospital 
before this particular project was put into opera- 
tion. However, it became important, for many 
reasons, to have t-he hospital records of these el- 
derly patients available at the Queensbridge health 
center when these patients came in for care. It 
turned out that one of the health department 
nurses lived near the hospital and went by there 
every morning on her way to work and could ob- 
tain and return the hospital records. When Mrs. 
Jones was at the program and needed care, some- 
how or other all the rules made up in the central 
office regarding what could or could not be done 
managed to be ignored, especially when you faced 
the problem of doing something specifically for 
her. In this case, the rule of not letting a record 
out of the hospital was broken. 

There was no problem nobody suffered 
and, as a result, the patients have gained consid- 
erably. 

One of the evaluation elements of this study 
that we want to look at very closely is the impact 
of the program on hospital utilization by this el- 
derly group as compared with similar elderly 
groups in another housing project about the same 
distance physically removed from the hospital. 

Another aspect of this which I want to 
mention has to do with the quality of care. We 
would like to come to grips, if we could, with the 
measurement problems in this area. To illustrate 
I will cite a particular case. 

This case concerns a man who had diabetes, 
a heart condition, and three or four other things 
wrong with him. When he came to the Queens- 
bridge housing project, they asked him what his 
problem was. He said, "My problem is my wife," 
His wife was about the same age as he was. Many 
of these people are in their seventies, and she could 
not get around as much as she would have liked. 
As a result, ho had to take care of her, and he was 
worried about this. This was his major problem, 
Now, if this man had gone to the municipal hos- 
pital there is practically no question but that he 
would have been shunted from one outpatient 
clinic to another in this particular hospital. Also, 
he very likely would have been hospitalized, and 
his wife would then have become even more of a 
problem. 
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Here, we come right back to the question 
that was raised this morning what is the function 
of the hospital in this bind of a situation ? 

NEW PATTERNS OF CAKE, What we 
are attempting in terms of direction of future re- 
search in New York City is to find ways of setting 
up different patterns of medical care that can be 
evaluated. This is not easy it is experimental 
it is expensive but we think that it is a worth- 
while approach because at the same time we are 
providing a form of medical care to some groups 
of people who have not received this kind of care 
before, and we are learning ways to get at this kind 
of thing. 

There is one final comment that I would like 
to make. In the last three weeks I have had two 
very interesting meetings in my office. Two people 
from different hospitals came to see me to talk 
about ways of changing the hospital to a commu- 
nity hospital. These are their words, not mine, 
and this development is partly a result of Dr. Trus- 
sell's program of affiliating municipal hospitals 
with the teaching hospitals in the community. He 
is attempting to develop the program in such a 
way that there will be full-time chiefs of staff for 
the services of the hospital. 

Now, one of the physicians who came in to 
talk with me said that he was very interested in 
what happened when he went out to recruit people 
for these chief -of -staff jobs. He said to these men, 
"Wouldn't you like to come here and become chief 
of medicine or chief of surgery?" There was a 
polite silence, but no particular spark of enthus- 
iasm was aroused. He then snid, "Wouldn't you 
like to be chief of medicine in Brooklyn Hospital 
and help us turn this into a community hospital, to 
\vork with Cumberland Hospital, to work with the 
health department, to work with the housing de- 
partment, to see what we could do witli the nurs- 
ing homes so that we could come up with ft bal- 
anced hospital community?" Well, when they 
were spoken to this way there was a considerable 
interest. It is very interesting to see that this 
type of thing is capturing the imagination of peo- 
ple who might be recruits for these kinds of posi- 
tions. 

I would sum up these remarks by saying 
that I think that one of the directions research, can 
take in the field of hospital utilization is to ex- 
amine the hospital in relation to its total role in 
the community, and to attempt to do this through 
various kinds of experimental situations. 



THE CHAIRMAN: 
Thank you very much, Paul. 

Avenues of Research 

MR. WALTER McNERNEY: 

I should like to comment very briefly, on a 
few avenues of research that seem to be indicated, 
on some methods and techniques, and then add a 
few general comments on such matters as research 
manpower and implementation of findings. 

As far as avenues of research are concerned, 
I hope that somebody will interest himself in look- 
ing 1 more definitively at the extent to which bene- 
fits meet, on a percentage basis, total or aggregate 
medical expenses of individuals. 

If this were done, for example, on a popula- 
tion-survey basis, we would have much greater 
sensitivity in measuring the extent to which insur- 
ance influences use. We could look at the degree 
to which basic versus major-medical type coverage 
meets episodic costs, rather than simply describe 
people as insured or not insured. 

I should like to stress the desirability of ex- 
panding the studies of effectiveness (ideas which 
I am sure that Tom Fitzpatrick, Don Riedel, and 
BBV Payne share) to a population basis, to get at 
tliose who are not hospitalized as well as those who 
are hospitalized and to get at the many democratic, 
social, and economic variables that could be related 
to effective and ineffective use. 

The criteria involved in the effectiveness 
studies need to be extended to new diagnoses. 
Better criteria for the evaluation of procedures are, 
needed. Self-survey kits should be developed for 
use by hospitals. Such questions as why doctors 
vary from the criteria should be asked. For ex- 
ample, what are the age, medical school, hospital 
appointment, and similar characteristics of those 
who do vary to a greater or lesser degree. 

In all probability, for some purposes, 
screening procedures will have to be developed to 
focus on sub-groups of users in particular diag- 
nostic categories in order to achieve sufficient sta- 
tistical reliability. 

The interaction of experience and com- 
munity rating needs to be studied over a larger 
number of years and with a larger number of 
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groups than has been done to date. They need to 
be interviewed and asked why they changed from 
one form to another and more details associated 
with the change, such as age, sex, economic status, 
and family size, need to be gathered. What are 
the dynamics of the interaction? Does the volun- 
tary system have an insoluble problem? 

I would hope that there would be a greater 
research interest developed in the effect of home 
care, nursing home care, and ambulatory care on 
episodic costs. There is a great deal of specula- 
tion on this. 

We need to follow selected patients _ over 
periods of time under various forms of practice to 
come to grips, more definitively than we have to 
date, with the issue of productivity. What is the 
comparative productivity of group practice versus 
solo practice? Tt would be possible to match the 
characteristics of physicians and patients under 
two dissimilar types of organization for study 
purposes. 

We talk a great deal about admission rates 
and about length of stay, but a larger factor in- 
fluencing costs is per diem cost in the hospital. 
The whole issue of the efficiency of the hospital it- 
self should be given closer attention. 

If I could express a general prejudice re- 
garding these and many other needed projects 
that could be named, it is that more research needs 
to be done on a population basis and on an episodic 
basis, utilizing many of the new sampling and ana- 
lytical tools that have been developed in recent 
years. We are attacking too many problems on a 
highly segmented basis and finding ourselves un- 
able to talk of meaningful results or implications. 
We now have both the insights and techniques to 
take bolder steps. 

A great deal of work can be wasted unless 
qualitative references or measures of effectiveness 
are developed. For example, differential admis- 
sion rates between high and lovr income groups 
becomes sterile without some knowledge of a 
proper, acceptable, or feasible rate. 

When we talk about these types of research 
we are talking about major sums of money. "We 
must then, get used to the idea that $500,000 is not 
an improper amount to spend, especially in terms 
of the importance of the many policy decisions 
that are involved. If the allegation is true that 
too much money is available for research, let one 
point of economy be fewer and deeper efforts. 
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techniques and Methods 

Turning to methods and techniques, the need 
for better basic records is pervasive in terms of 
their filing, uniformity, and contents, both in and 
out of the hospital. Hospital and office records 
are often sketchy and not always fijed systemati- 
cally. Prepayment records often lack basic infor- 
mation such as age and sex of dependents. We 
need more work on sampling, more work on ana- 
lytic tools, more work on interviewing techniques, 
more work on instrumentation. We need to per- 
fect ways of validating source data. 

I should like to suggest that many govern- 
ment and nongovernment grants include an "x" 
amount for work on method and technique. Too 
often our enthusiasm outruns our tools. Certain 
grants should be made, of course, to strengthen our 
tools alone. 



General Comments 

MANPOWER CONSIDERATIONS. 
As far as general comments are concerned, I 
should like to talk for just a moment about man- 
power considerations, I think we have to develop 
a lot less self -consciousness about backgrounds and 
to promote a much more liberal mixing of skills, 
with the leadership of those skills, in today's com- 
plex research environment, going to the man who 
can get things done, whoever he may be. 

We need a variety of skills in many projects 
because often when an economic phenomenon is 
being looked at, the essential problem turns out to 
be psychological or vice versa and this point is too 
often lost. In many cases, particularly when uti- 
lization and allied problems are being investi- 
gated, the nature of the inquiry demands many 
skills working in harness. Because of the lack of 
trained people with degrees, bright relatively un- 
trained people should be sought out and given op- 
portunities. Many can provide very effective new 
ideas and sometimes even leadership in the course 
of a project. There is a large untapped reposi- 
tory of talent among those with large capacities 
and little schooling. 

Persons with operating experience should 
be included in many social or economic research 
projects to help pose sound questions, to help de- 



velop effective contacts with the field (obtain data, 
cooperation on interviews, etc.) and to help with 
interpretations of data. Without the stimulus of 
such persons some research workers have inad- 
vertently spent too much time on irrelevancies or 
pursued favorite themes beyond their worth, 

IMPLEMENTATION. Bayond research 
per se lies the area of implementation. Too 
often a project is done which develops a technique, 
a tool, or an idea that ends up in a publication 
which gathers dust. I should like to make two 
suggestions. One is that universities and other 
research institutions give sabbaticals to selected 
men who have completed research projects so that 
they can help implement the findings when there 
is a good socio-economic justification involved. 
Administrators in the operational field should also 
make sabbnticals available to assistants to assist 
in research and its implementation. The second 
suggestion is that granting organizations make 
provision in their grants for implementation of 
findings pending successful work which can be 
evaluated while underway. I am talking of a 
second "x" factor. Many highly useful findings 
now lie idle. 

In closing I should like to express the hope 
that we can withstand the temptation to fall into 
rigid ideological camps. "We are in a value-laden 
field and the temptation to move in preconceived 
directions according to personal prejudices is 
great. The operating field and patients need 
objective, well -disciplined help and they deserve 
nothing less. 



Group Prepayment Plans 

MR. GEORGE ST. J. PERROTT : 

I agree with Dr. McNerney that data on 
hospital utilization are most valuable when they 
can be related to a population base of persons both 
sick and well. Information related to the hospital 
universe only that is, the sick person is useful 
but has its limitations. However, ii population 
base is usually impossible to obtain for an indi- 
vidual hospital. 

I have been interested for some time in the 
operation of the group practice prepayment pro- 
grams which have a built-in population base. In 
the fall of 1960, 1 had the privilege of being co- 



chairman of a conference at the School of Public 
Health in Pittsburgh on the subject, "Health 
Studies of Human Populations." Here we at- 
tempted to identify certain principles and guide- 
lines applicable to the planning and execution of 
studies involving human populations. 

Conferees were supplied in advance with 
case histories of some 12 outstanding currently ac- 
tive population study centers. Most of these in- 
volved geographically circumscribed communities 
such as Hagerfitown, Maryland, or Alameda Coun- 
ty, California. These have recently come to be 
known as "human population laboratories." Two 
of the 12 involved studies where a group practice 
prepayment plan was being used as the research 
laboratory. One study, by Sam Shapiro, is being 
carried on among members of the Health Insur- 
ance Plan of Greater New York. Here the avail- 
ability of comprehensive care and continuous 
health records on the enrolled population have 
made possible a study of a health problem of older 
people coronary heart diseases. At the other end 
of Iife> medical information on women as to the 
outcome of pregnancy and on congenital malfor- 
mations is being obtained by Shapiro at HIP and 
by Yerushalmy at the Kaiser Health Plan in 
California. 

UNIFORM DATA PROGRAM Realiz- 
ing that the potentialities of prepaid group prac- 
tice settings for contribution to medical knowledge 
will be enhanced and better utilized as the result 
of- a uniform basic data program, the Group 
Health Association of America recently applied 
for and received a grant from the Public Health 
Service for a "Nationwide Collection and Utiliza- 
tion of Basic Statistics on Comprehensive Medi- 
cal Care Provided Through Prepaid Group 
Practice." 

In connection with this project, the Assist- 
ant Director and I have just made a series of visits 
to some 18 plans in various parts of the country 
to collect descriptive data on their operation, o.g., 
(1) location and general type of community 
served, methods of operation, staff, facilities, and 
scope of services, (2) population enrolled by age, 
sex, and such other characteristics as were obtain- 
able, and (3) amounts of professional and other 
personal services and utilization of hospital and 
other facilities. 

The plans visited varied in size from 2,400 
1 o 564,900, embracing a total of 1,575,000 enrollees. 
Some o\vn their own hospitals, some self-insure 
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or hospitalise through Blue Cross, and some pro- 
vide only out-of-hospital services. As might be 
expected, records kept and statistics derived from 
them vary greatly among the plans. 

One of our early findings was that the popu- 
lation base, though "built-in," was not always 
available for statistical tabulations and particu- 
larly not when the population was to be classified 
by age and sex. The raw data were on paper 
somewhere but not always easily accessible. This 
was sometimes the case in health plans financed 
through union welfare funds where the popula- 
tion data were kept by the welfare fund. 

In obtaining statistics, standard definitions 
must be used for such items as covered persons, 
person-years of exposure, and different persons 
covered in specific time periods. In counting 
medical services rendered, there must be standard 
definitions of physicians' services, ancillary serv- 
ices, preventive services, etc. Counting labora- 
tory services presents another problem of defini- 
tions, e.g., a complete urinanalysis may be counted 
as 1, 2, or 5 services depending on the counter. 
In this connection, it should be mentioned that 
there are certain ratios not referred to the total en- 
rollment that are significant in terms of plan oper- 
ation. Some of these indices, e.g., physical 
examination, appendectomy and tonsillectomy, 
laboratory and X-ray services expressed as ratios 
to total physician visits and infant and maternal 
mortality rates per 1,000 live births, may be re- 
lated to quality of medical care. 

As far as data with a population base are 
concerned, we are thinking of starting out rather 
modestly. We have given up, for the present, 
the idea of getting diagnostic data but rather start- 
ing with something of this sort: physicians' serv- 
ices per enrollee-year office, home, and hospital ; 
physicians' services classified by medical 
specialty per enrollee-year and per patient (this 
gives some indication of diagnosis) ; percent of in- 
dividuals receiving one or more services a figure 
which varies from a low of 30 percent in some of 
the smaller plans to 75 percent in some of the 
plans offering comprehensive services; hospital 
utilization classified as medical, surgical, and ob- 
stetrical ; laboratory and X-ray services. 
VARIABLES IN HOSPITAL USE. During 
this meeting we have heard the results of studies 
comparing hospital utilization by subscribers of 
group practice prepayment plans with fee-for- 
service prepayment plans. Several studies have 



shown lower hospital utilization by group practice 
prepayment subscribers ; others have reported little 
difference. What impressed us on our recent trip 
was the tremendous variation in hospital utiliza- 
tion from one plan to another. The lowest was an 
annual rate of 0.25 days per enrol lee and the high- 
est around 1.3 days per eligible enrollee; doctors' 
culls from 2.4 to 5.0 visits per enrollee with home 
calls varying from 10 to 700 visits per enrollee 
per year. 

Obviously we must have a better under- 
standing of the relationship among factors such 
as the characteristics of the population at risk, the 
insurance mechanism, and the organization of 
medical services before it is possible to generalize 
about hospital utilization. Differences in local 
resources for hospital caro and in local practices 
in hospitalizing patients certainly play an impor- 
tant role. Possibly characteristics of the insured 
population not usually measured by the statisti- 
cian are involved. 

This was one of a number of special prob- 
lems that came up frequently during our recent 
field trips. I have a list of some 20 here whose 
solution would contribute to the more efficient op- 
oration of the plans and might well have broader 
application. Among these were : factors affecting 
hospital utilization; prepayment coverage of 
mental illness, dental care, drugs, pre-existing con- 
ditions, care of older persons; staffing patterns; 
appraisal of quality of care; group versus individ- 
ual membership utilization ; productivity of peri- 
odic physical examinations versus multiphasic 
screening; reasons for variation in utilization 
among different contract groups. 

Wo are under no illusion that we shall solve 
all these problems during the period of our grant 
but we hope to stimulate some work by the plans 
themselves.- We are also planning a consultation 
service to assist plans in developing statistical data 
from their record-keeping systems and in making 
practical use of the information. 



The Physician's Role 

DR. WILLARD WRIGHT: 

I would like to speak briefly as a member 
of the Council of Medical Service of the American 
Medical Association. Our function is really to 
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delve into all the methods under which medical 
services are provided in this country. This refers 
to the methods under which doctors work and per- 
form their services and, of course, methods of pay- 
ment for these services. 

I will not go into all of our many interests 
in this field. It is unfortunate that none of us can 
bo completely knowledgeable in all this wide area, 
but we do have people who work for and with us 
and help our understanding. 

At this moment we are quite deeply con- 
cerned and we do not call this research because 
wo don't do research ; we just study things and try 
to learn with the reassessments, which we hope 
will be realistic, of relationships existing between 
physicians and hospitals and under what circum- 
stances physicians should work in hospitals. 

Our method of procedure is almost com- 
pletely opinion and attitude survey. We simply 
interview people who are knowledgeable in the 
field and who are leaders in their particular area 
of interest and get their ideas and attempt to put 
them together. Unfortunately, we have never been 
able to feed these into a computer and get anything 
hack out. 

I would suggest to this groiip that perhaps 
there is much to be learned by talking with repre- 
sentative physicians about utilization and quality 
of medical care, which seem to be interrelated in 
these studies. 

I would suggest to them that the person who 
is delivering the service is, after all, the one person 
who knows a lot of answers which you are trying 
to get in other ways. I would further suggest that 
no study or appraisal of the quality of medical 
care in an individual instance be considered com- 
plete unless the individual doctor who rendered 
the care has had an opportunity to explain the 
circumstances under which such care was given 
because, after all, we are dealing with people and 
people are imperfect. The doctor is just as imper- 
fect as the next person, and a doctor takes care of 
a patient depending a great deal on what the atti- 
tude of the doctor is toward the particular situa- 
tion and what the attitude of the patient is toward 
the same situation. 

You have many areas involved here. You 
have the highly over-cautious doctor and you have 
the highly over- apprehensive patient. You have 
the devil-may-care doctor, who will take every- 
thing in stride; you have the patient who pays no 
attention to what the doctor says you have all 



these many, many factors and they must all be 
taken into consideration. 

Furthermore, it seems to me that the atti- 
tudes of doctors and the attitudes of patients are 
very closely related to the so-called economy of 
abundance under which Americans live. In 
medical care, certainly during the last 20 or 30 
years, there has been a good deal of this abun- 
dance nothing is too good for the patients and 
anything that we can provide them with is what 
they need. This is just the American way of do- 
ing things this is American business and people 
who were brought up with this attitude are going 
to carry that over into the medical field. You can- 
not talk these people into pinching a dollar here 
and there by staying out of the hospital a couple 
of hours, a couple of clays, or- a couple of weeks less 
if they decide they don't want to do that. 

THE CHAIRMAN: 

Dr. Wright, thank you for your comments. 

I don't think that I did very well in intro- 
ducing Dr. Kerr White. I mentioned him yester- 
day. I think he is very well known to this group 
as a member of the faculty of the Medical School 
at Chapel Hill, North Carolina, where he was in- 
volved in some very interesting medical care re- 
search. During the past year he has become pro- 
fessor and chairman of the Department of Epi- 
demiology and Community Medicine at Vermont, 
as you can see from your program, although I 
think that he lias been a member of one of the 
study sections concerned with this type of research 
for quite a few years. He has just, within the past 
6 mouths, become Chairman of the Health Serv- 
ices Research Study Section of the National Insti- 
tutes of Health concerned witli the type of re- 
search we are discussing. On many counts, we 
will bo interested in any comments you want to 
make. 



Alternative Health Facilities 

DR. KERB L. WHITE: 

First of all, I would like to express the 
thanks of the Study Section for this invitation 
from Dr. Crosby, Dr. Haldeman, and Mr. Bugbea 
for our members to attend and participate in these 
discussions. 
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Perhaps a word or two about Mie name of 
the Study Section might be helpful. It was 
originally known as the Hospital Facilities Study 
Section until the U.S. Public Health Service, an- 
ticipating the future, several years ago changed 
the name to Health Services Research Study 
Section. I think that this broader title perhaps 
suggests some of Hie changing emphasis that has 
characterized the discussions of the last day or 
two. No longer can we be restricted to the hos- 
pital us the only health facility to be considered in 
discussions focused on utilization. 

I suppose that we are making some head- 
way in examining the assumption, that physicians 
are the sole arbiters of what is good for the pub- 
lic's health. There are many other professions 
and people concerned with the public's health these 
days, not the least, of course, being the consumers 
who are footing the bill and are more and more 
interested in the sorts of services they want and the 
level of quality they expect. There are, however, 
other assumptions that could bo looked at. 

One of these maintains that the hospital 
ward is the solo or most important place in which 
to provide exemplary medical care. It is worth 
recalling that if there are 1,000 adults at risk in 
a community, in the course of a month about 7150 
of them will have an injury or illness which they 
can recall at the end of that month. About 250 
will consult a physician and only about 8 or 9 will 
bo admitted to a hospital. It is apparent that the 
vast bulk of medical care is given outside the con- 
fines of the hospital ward. This raises serious 
doubts about the wisdom of using the bed as the 
primary unit for assessing utilization of hospitals 
or oth&r health facilities. 

Another assumption states that the object 
of the health services of a society is to keep people 
out of the hospital and that hospitals only deal 
with the failures of the health services system. If 
the health services are unsuccessful in maintaining 
a high level of health in the community and in 
keeping people well and functioning at a socially 
productive level, they may collapse and require 
the services of the hospital. If this assumption is 
valid, then the hospital administrator, instead of 
considering improved ways of filling beds, con- 
cerns himself with improved ways of getting 
needed services to the consumers at an earlier state 
in the natural history of disease. Again, if you 
accept this assumption, you get away from fcli" 



idea that the bed is the primary unit of medical 
care. 

CQNTINTJTJM OF SEE VICES. Many 
of the discussions during the past two days seem 
to have been closely identified with the bed and 
the notion that the only legitimate patient is the 
horizontal patient between clean sheets. There 
has been little discussion about the health facilities 
required for the vast bulk of illness, which extends 
between the needs of the person who just doesn't 
feel well and the expensive care provided on the 
traditional hospital ward. What I am suggesting, 
therefore, is that it is extremely difficult, to discuss 
hospital utilization without considering the alter- 
native facilities and resources for providing pa- 
tient care. Even within the hospital it is impor- 
tant to discuss the problem in relation to levels of 
nursing and patient care required in accordance 
with the concepts of graded or progressive patient 
care, for example. There is a wide continuum of 
services to consider; and I would like to mention 
briefly several areas in which research might pos- 
sibly be carried out. 

If we regard it as desirable to look at units 
of medical care and health services other than the 1 
traditional bed, one of the most promising might 
be the patient himself. We could forget about 
beds and study the natural history of medical care 
or oven the natural history of symptoms. We are 
plagued with the notion vhat disease has to be 
measured or defined by the finite labels given to 
it by the university physicians on the teaching 
wards, and the notion that you cannot have a 
recognizable medical disorder until some doctor 
names it. Sir James MacKenzie, almost 60 years 
ago, set out to study the natural history of symp- 
toms, to see what happened to the people's com- 
plaints and symptoms over the months and years, 
and to determine what the final outcome was. In 
the last analysis, it is the complaints, symptoms 
that interest, patients. MacKenzie took patients 
with assorted complaints and followed the natural 
history of their medical care. This kind of cohort 
study, applied to the utilization of health facilities, 
including, of course, hospitals, might provide im- 
portant insights into some of our problems of 
over-, under-, and inappropriate utilization of 
these facilities. 

Studies are needed of the circumstances un- 
der which different types of patient care are 
needed, demanded, and provided. Why is it that 
most physicians ore most comfortable looking af- 
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ter patients on hospital wards? What could be 
done to provide the specialized facilities, organi- 
zation, and personnel required to make it possible 
for physicians to provide equally exemplary and 
even more effective care of its kind outside the hos- 
pital ward and even outside the hospital ? This in- 
volves looking at the physician, the nurse, and the 
other health personnel as primary units, rather 
than the ted or the institution as the primary unit. 
Specifically, what needs to be done to improve the 
capacities of physicians to work as comfortably, 
effectively, and enthusiastically in outpatient de- 
partments, clinics, and offices as they do in hospital 
wards? If we knew more about this, we might 
be able to shed more light on the problems of hos- 
pital utilization. 

We really do not know much about the aims 
and values of hospitals as institutions. It is as- 
sumed that they are "good" and in the best interest 
of society. But specific analyses nre lacking. Al- 
though the social scientists have been entering this 
field with increasing enthusiasm and productivity, 
more activity is needed. I am told that a recent 
paper published in Germany is entitled "The Sick 
Hospital." There is really no institution in so- 
ciety that has as many conflicting aims, objectives, 
and roles as the hospital. There are the patients, 
trustees, physicians, nurses, medical f-tudents, resi- 
dents, housekeeping personnel, telephone opera- 
tors, and receptionists, to say nothing of the 
administrators and accountantsall with different 
goals, aspirations, and understandings of the situ- 
ation. "We need to have a great deal more infor- 
mation about the social structure of hospitals and 
the interacting social and perhonal factors which 
condition the therapeutic community in which pa- 
tients are expected to improve. How can the 
human resources in the health field be organized 
most effectively to promote the recovery of pa- 
tients? What, human factors encourage patients 
to shift from their beds to other health facilities at 
the most appropriate time? The approaches de- 
veloped by Gofman, Frieclson, Revans, and King 
all need wider application. No simple solutions 
will be forthcoming, but there is a need for a better 
understanding of the milieu in which patient care 
takes place. 

IMPROVED COMMUNICATIONS 
NEEDED. We need studies of information flow. 
How do the various health professions, their 
patients, and other groups communicate with each 
other? Certainly we need studies of the quality 



of care, but we need to go further back than that. 
In one study carried out at Chapel Hill, in the out- 
patient department, we found that some 17 percent 
of the clinic patients did not have their chief com- 
plaint touched upon the principal thing that 
brought them to the hospital was not investigated 
at all. How frequently does this sort of response 
go on in other institutions? Such failure of com- 
munication can hardly fail to affect utilization 
patterns. As further evidence of poor communi- 
cation, we found that some GO percent of the 
patients coming to the clinic entered into a con- 
sultant arrangement with that clinic without any 
relevant medical or social information being pro- 
vided by the referring physician. This occurred 
in spito of strenuous efforts to obtain adequate re- 
ferral information. Is it any wonder that there is 
inappropriate utilization of health facilities when 
the most elementary forms of communication are 
neglected? Perhaps these are typical examples, 
but there- is enough evidence to suggest that the 
matter should be examined more extensively. 

As an example of inaccurate, if not pur- 
posely misleading, communication, one may cite 
the whole unprofessional, if not unethical, busi- 
ness of arranging for hospital admissions under 
guises of one- kind or another to satisfy the needs 
of insurance carriers for payment of the bill, for 
admissions officers or administrators to jusitfy the 
demand for a bed, or for house staff or consultant 
physicians to interest them in the patient's prob- 
lem. Again the whole approach to patient care is 
geared to the outmoded concept of the bed as the 
primary unit of medical care. The approach is to 
justify the use of a bed rather than to obtain ap- 
propriate patient care. 

Referrals of patients to outpatient depart- 
ments may be similarly made in misleading ways, 
particularly when the physician wants to shift or 
transfer responsibility but is not prepared to say 
so clearly. We asked physicians why they re- 
ferred patients to the hospital clinic and we were 
given altruistic statements about the need for 
diagnostic facilities, better judgments, and wiser 
opinions of the kind which might be available in 
the particular clinic or hospital. When asked, 
however, why a particular patient was referred, 
we were frequently given such comments as "to 
get rid of her," "to get her off my hands." This is 
the same sort of phenomenon Dr. Davies spoke 
about this morning when he spoke of patients be- 
ing "dumped" on consultants. "Dumping," how- 



123 



ever, isn't a very satisfactory way in which to deal 
with the consumers' needs for medical care; nor is 
it a particularly responsible way to utilize ex- 
pensive social facilities such sis hospitals and 
clinics. There may be very good reasons for shift- 
ing responsibility, but these should be clearly 
stated. We need to know more about the reason 
why some physicians dislike dealing with par- 
ticular types of patients, and we should provide 
services which will meet these needs rather than 
having the needs communicated in some form of 
traditional jargon which seems to justify appro- 
priately the demand for a bed or a service. 

OTHER PERTINENT RESEARCH. 
There is a need for studying information find 
patient flow in the broader context of regionali- 
zation. Studies of the sort that Newell has done 
of the grass-roots basis for patient's patterns of 
travel to and from institutions are needed. If wa 
studied ecologically, the commuting and trading 
patterns of communities and regions, wo might be 
in a better position to project a more rational clis- 
persement of our medical facilities and resources 
than has apparently been provided on the basis of 
centralized planning with minimal study. 

One of the great advantages we have under 
the voluntary system in this country is the oppor- 
tunity for many different kinds of experiments. 
Britain and the Scandinavian countries each have 
one grand experiment per country. As a conse- 
quence, they are somewhat limited within that 
framework. They have many possibilities for 
studying their particular system but there are con- 
straints. In contrast, we have many opportuni- 
ties, and there is a great need for experimentation 
of all kinds. Accompanying this is the equally 
great need for evaluation of the results of any 
kinds of experiment. Even in tho field of human 
behavior there are now techniques available for 
comparing the behavior of relatively large groups 
of individuals. 

I should like to mention the need for cre- 
ative architectural studies. Hero again wo are 
plagued with the bed as the primary unit of medi- 
cal care. Instead of thinking in terms of this 
stereotype, surely we could write new kinds of pro- 
grams for patient care, describe new forms for 
therapeutic communities, and the sorts of environ- 
ments in which patients are found to do well find 
improve. We could then give these descriptions to 
the architects and let them design a completely 



different type of facility. At the present time, 
we usually describe a need for a number of new 
beds instead of providing an architect with a pro- 
gram and allowing him maximum opportunity for 
creativity. Why must we always have to do our 
thinking about patient care in relationship to the 
bed? 

RESEARCH METHODS. Now, a word 
or two about methods. I will not repeat the points 
Dr. McNerney covered, but there is a real need for 
developing adequate methods in this field. In the 
Health Services Research Study Section we see 
many applications dealing with important prob- 
lems, which it is proposed to tackle without hav- 
ing available an instrument or method suitable for 
investigating the problem. Take the matter of 
progressive patient care. Our group has been look- 
ing at the criteria used for classifying patients. 
In a sample of over 1,200 patient days, for which 
wo have independent classifications by nurses and 
physicians of levels of patient care needed, there 
tira substantial discrepancies. At the intensive 
care level there is agreement between physician 
and nurse about the level of care needed in 54 per- 
cent of instances; at the intermediate level the 
agreement is 87 percent ; and at the self-help level 
the agreement is 37 percent. It seems clear that 
until wo have some kind of reliable instrument for 
assessing nursing care needs, it is unlikely that we 
can make much headway in evaluating or even 
implementing progressive patient care. 

We have both a tremendously difficult and at 
the same time challenging field in medical care re- 
search, hospital research, health services research, 
or patient care research. This is a continuum and 
the various substantive areas are in process of 
gradual definition. In any of them, however, it 
is important to select reasonable problems which 
can bo tackled with reliable methods. 

These are some of the directions in which, 
it seems to me, research of various kinds in the 
health services field needs to be encouraged. I have 
sketched out all this on a bit of a "cloud 9" level in 
order to encourage a broader view of the health 
services problem than that which is solely con- 
cerned with bed utilization, We have heard some 
excellent discussions about hospital utilization 
studies; but surely we need to know much more 
about the whole system in which "beds" and all 
the alternatives to bed .utilization are needed, de- 
manded, and used. 
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One final word or two about communica- 
tion. Certainly a meeting of this kind does a great 
deal to promote exchange of ideas. There is still 
a great diversity of unrelated arenas in which re- 
petitive discussions of health services research take 
place. Not only are there local, regional, and na- 
tional conferences, but there are the public health 
journals, hospital administration journals, medical 
and nursing journals, behavioral science journals, 
and journals devoted to chronic disease, rehabilita- 
tion, and specialized problems. There are journals 
not only in this country but in other countries as 
well. There are the abstracting services and there 
is the new journal Medical Care. The readers of 
one group of journals or the participants in one 
set of meetings may rarely know what is going on 
in the other conferences or in other publications. 
There is a real need, it seems to me, for some new 
form of communication, perhaps a broader sort of 
abstracting service than that available from the 
American Hospital Association or the Ministry of 
Health in Great Britain. Perhaps the Public 
Health Service might provide this kind of service, 
and I am sure they would welcome suggestions. 

The Health Sen-ices Research Study Sec- 
tion is going to meet later this week and we hope 
to discuss possible approaches to programing; and 
to ways of encouraging a variety of investigators 
to enter the health services field. In addition, we 
shall address ourselves to the problem of communi- 
cation and will welcome any suggestions. 

THE CHAIRMAN: 

Thank you very much. Now then, I would 
like to again call on Dr. Brother^ on for his com- 
ments on research or anything else. 



The Patient as Dominant Partner 

DR. BROTHERSTON: 

Thank you very much, Mr. Chairman. It 
is irresistible, of course, to be allowed to sound off 
about things that ought to be done, especially when 
I have no responsibility for showing how I would 
do them or what it would cost. 

Looking at the system of medical care and 
areas for examination in a very general sort of 
way, the medical care system operates essentially 



as a partnership of patients and doctors in relation 
to professional people and administration, and I 
think that each of these areas needs some examina- 
tion in terms of this partnership. The dominant 
partner, of course, although this isn't perhaps suf- 
ficently recognized, is the patient. The whole sys- 
tem goes into action simply because of the patient's 
aggravation he presses the button and then the 
doctors and others jump about and do their stuff. 
How good a job is th& patient doing? I 
think that in our kind of situation, where we are 
claiming to provide total care for our population, 
it would be just as well if we could have some 
system of spot-checking from time to time as to 
what sort of a job the patient is doing in working 
the system. J think that Odin Anderson referred 
to some of the kinds of opinion studies that we 
need. Of course, we have glimpses of this kind 
also, hut not so well-formulated. 

There is no doubt that a considerable 
amount of patient-recognized illness exists which 
has no attention paid to it by the doctor. My 
opinion is that this is in the clinic and in the early 
visits, and is very often the outcome of a rather 
fatalistic kind of approach that these doctors 
cannot do anything for this kind of thing anyway. 
However, I think that some- system of spot-check- 
ing the population, some clinical checkup system is 
a necessary control for our kind of service if we 
are really to know what sort of job we are doing. 
It is very difficult to work out the methodology 
but highly desirable to be able to do it. 

Also, I think we need to examine profes- 
sional self-controls much more carefully. In the 
last resort, this is the only kind of control that 
really matters. Some of our older forms of con- 
trol essentially have been markedly changed, of 
course, because the private enterprise element has 
been taken, out of our medical care system. This 
niiiy make it, all the more necessary to examine now 
kinds of self-control mechanisms, 

It is disappointing for us to learn that your 
internal audit has rather run on to evil days and 
doesn't seem to be held in much esteem. But some 
sort of answer is needed in terms of feedback on 
the part of the professional group on the one hand, 
and the group on the other hand which receives 
this and passes judgment on it. This, I am sure, 
is the basic mechanism, and we need to know- more, 
from experimental studies, about what informa- 
tion to feed back and what sort of group you have 
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to feed it back to. If the group works effectively, 
does it always inevitably depend on one leader as 
seems to be the case at the present time? Or can 
group situations be devised which place yon less at 
the mercy of the emergence of some particular 

figure? 

When it comes to looking at the effective- 
ness of clinical work of the medical care systems, I 
am impressed with the potential values of the"so- 
what" kind of study that we have been talking 
about today. I think we need to recognize the 
weakness of the individual single hospital episode 
as a source of information. We must not forget 
that hospital care is episodic nnd may hear very 
little relation to the final outcome as Tar as the 
condition is concerned. Therefore, I think, we 
need a much more epidemiological approach. 

Perhaps the greatest single problem we have 
in terms of clinical organization is in (he field of 
general practice. I believe that there are certain 
kinds of problems that you cannot approach ex- 
cept on an experimental basis. You can talk 
about alternatives until you are blue in the face, 
but until you have had a chance of examining them 
and comparing them and the outcome, you really 
do not know how to proceed. 

One of the weaknesses in our health service 
has been our comparative inability apparently to 
experiment. We need some substantial experi- 
mentation in new forms of organization of domi- 
ciliary care in order to bring about the technical 
and other support needed, as I indicated this 
morning, and perhaps alternaiive systems of re- 
muneration as well. 

Now, on administration, I am impressed 
with the kind of approach which various agencies- 
are at least attempting to take. This work needs 
validation, but I am sure that this kind of look 
at the hospital system is helpful. Wo have bad 
this idea of interpreting the community in our 
minds for some time now. Is this a valid concept 
or not ? Is it true that by organizing your clinical 
arrangements in different ways you can in fact in- 
crease the total therapeutic, effect? For example, 
as opposed to individual therapy for patients, can 
yon improve medical care by bringing not only 
staff but other patients into the. situation as thera- 
peutic agents? This may be more important in 
long-term care than in short-term care, but it is 
surprising that there has been so little study of 
this particular concept, even in the terms of simple 



organization of patients' living relationships to 
each other. So, does this make a difference, or 
does it not? 

Then, looking at the total, of course, there is 
this question of communications, which, as Dr. 
White lias said, is quite vital communication 
intraprofessionally, communication between the 
profession, and the patients and we have all sorts 
of evidence from our system that our communica- 
tions do not work too well much of the time. We 
need a great deal of study on this, in a system which 
is inevitably articulated out of different subsys- 
tems. And, finally, this question of communi- 
cating among and to ourselves; I very much wel- 
come what Dr. White said about this. 

I am grateful for the opportunity to come 
over hero to listen to all of these things that are 
going on. I realize that wo don't know about 
them and if we had not been here, we would never 
have heard about them. It is not so much a ques- 
tion of the formal publication which I suspect can 
usually be tracked down, but so much of this work 
never gets into the final formal kind of publica- 
tion. Therefore, I think it would be tremendously 
valuable if some editing service would bring to- 
gether and discuss the work which has been done 
in the preceding year. Certainly I know that we 
would find this a very valuable service indeed. 

DISCUSSION 

THE CHAIRMAN: 

Today, it seems to me, the panel is summar- 
izing in great wisdom a number of points that 
would be worth rereading and thinking about, be- 
cause what each said is exactly what I had hoped 
would come out in this panel. 

We are now open for discussion and 
comments. 

MR.H.E.KLAEMAN: 

I would like to say something about the ex- 
perimental method that has been recommended. 
I think that there are very few laboratory condi- 
tions under which you can control all the variables 
in the situation. So what you typically get is some 
kind of program that comes into effect, a major 
change, and you want to look at it. I think that 
the difficulty there is that we miss many oppor- 
tunities. Eight in front of us we have the devel- 
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opment of the psychiatric unit of the general 
hospital, which has been going on for several 
years. Have we been looking at the effect, if any, 
on the admission rate of the State mental institu- 
tions ? What about the relationship between State 
mental institutions and the nursing home? 

Right now in Baltimore we arc switching 
our well-known medically indigent program from 
a salary basis to a fee-f or-service basis. You say 
that somebody ought to do it, but nobody is look- 
ing at it. I think that here again we are going to 
miss an opportunity. 

On a more narrow framework, I would make 
this suggestion in connection with the various uti- 
lization studies. I would like, in the future, to see 
a greater emphasis on length of stay. I think there 
is more of a pattern of this than perhaps we have 
realized. I think that we will find much larger 
differences in length of stay than we have found in 
admission rate. 

DR. MoNINCH: 

Just for information, the American Hos- 
pital Association is preparing, as a result of var- 
ious recommendations of its advisory council on 
research and education, an up-to-date bibliogra- 
phy in the hospital field. This will be presented 
to its advisory committees, hopefully, in February 
and March for discussion as to contents and for- 
mat, whether what is needed is an annotated bibli- 
ography, an extract publication, a review or digest 
or what. I hope that something will come of this. 
It is in process at present. 

MR. McNERNEY: 

Would you elaborate on the more important 
aspects of length of stay 1 

MR. KLARMAN: 

I thought that length of stay was important 
because of my experience in checking out two of 
the studies, the one Jo Williams reported on and 
the one that Paul Densen studied. In Paul's case 
I compared the admission rates and length of stay 
of his samples in relation to the respective popula- 
tion in New York City from which they drew. 
You see, he merely matched the sample he did 
not know whether or not they were representative. 
I found a rather small difference in admission rates 



and a very big difference in length of stay. This 
is in connection with some of the reasons that Sam 
Shapiro mentioned yesterday. 

In the case of the Williams study, her iind- 
mgs for admission rate were substantially the same 
as those in the national health survey for a given 
or same population. I proceeded to check out for 
length of stay and again I found a big difference. 

REPRESENTATIVE : 

I would like to make a comment about statis- 
tical studies and utilization. Dr. Klarman men- 
tioned more work on length of stay. It seems to 
mo that most of the statistical studies of utilization 
have been confined to descriptive or empirical 
studies. There is another branch of the field of 
probability in statistics which really treats the 
dynamics of test precedes the census of hospitals, 
occupancy really the interaction of several proc- 
essesthe admission or input process and length 
of stay the throughput process. If one wero to 
study utilization from the point of view of inter- 
acting dynamic processes, I think you could get a 
lot more information from (he statistics than wo 
get from the tabulation of statistics. 

It has been interesting to me to hear our 
English visitors refer to the operational work done 
in England and to note that operational research 
in this country seems to have been con lined to study 
of internal hospital operations and not applied to 
the community use of hospitals. Perhaps it is lie- 
cause of the regional organization in England that 
these researchers have looked at the regional prob- 
lem first. Nevertheless, I think that the comments 
today, compared with the American comments, 
and the kind of statistics applied, would show an 
opportunity for us in this country to look at some 
of the dynamics of the processes. 

DR. P. M. DENSEN: 

I would like to ask Dr. Flngle to expand on 
that just a little bit. I think that the idea of the 
dynamic approach is something that would be 
extremely worth while, but in the application of 
this approach you have to have some kind of ob- 
servational data to work with. I would ap- 
preciate it ii you would expand a little bit as to the 
kind of observations needed to carry out this kind 
of approach. 
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DR. FLAGLE: 

The data would have to bo observed in the 
form of sequence of events, the Limes of successive 
admissions to a hospital and the sequence of length 
of stay. From studies of these interactions, in 
lieu of certain constraints, one could see what kind 
of occupancy is possible. I believe that Dr. 
Blumberg, using (his approach, at one point indi- 
cated that an obstetrical unit, is about 80 percent 
occupancy and occupancy really implied 100 per- 
cent use of facilities. However, you would have 
to look at it from the point of view of the dy- 
namicshave it quoted to you oorrectely. There- 
fore, this really involves the collection of data 
perhaps in a more detailed way than would be 
necessary for tabulating statistics^ and then study- 
ing the way things happen with respect to time. 



stay? 



MR. McNEKNEY; 

This would include services during the 

UK. FLAGLE: 

Yes. It makes the observational process 
more difficult but, as far as I can see, it is the only 
way one gets to the root, of some of these problems, 
such as what makes up the two days of turnover- 
time that Bailey uses in his approach to the study 
of hospital populations. I should think the turn- 
over studies would involve the study of what hap- 
pens almost from minute to minute following the 
discharge of patients and during the process of 
admitting new patients, to get to the root of the 
turnover-time problem. However, it is the obser- 
vation of events in time that would be at the heart, 
of such statistics. 

ME. WECKWERTH: 

One of the things that wo wanted to investi- 
gate in the study was this kind of sequential thing 
that you are talking about. It was also alluded 
to in the Michigan study yesterday the necessity 
of knowing the occupancy at the time the patient 
is discharged. This is the kind of thing that wo 
did investigate. We have fcho data on this kind of 
thing because we felt it was relevant to know what 
the occupancy was at various services and we also 
had to know the impact upon the entire commu- 
nity at any given time rather than just from an in- 
dividual Hospital. 



In St. Paul, we now have all hospitals re- 
porting on a standard form, with standard data 
from all of them for every admission in St. Paul. 
It will be done with all of (heso things so that we 
can check on a day-to-day basis the kind of oc- 
cupants that- we have, the kind of services, the 
length of stay. 

"We have the information to study average 
lengths of stay with respect to weeks of the year. 
We have this all laid out by week of the year for 
the entire year. This information also relates to 
demands for use. I am puzzled by this because if 
I were a hospital administrator I would certainly 
want to know the experience during the summer 
months. 

It is interesting to note that obstetrical serv- 
ices in the entire Twin City area are down 15 per- 
cent during the Fourth of July, 16 percent during 
Memorial Day week, and 12 percent during Labor 
Day weekend; they fall off very badly during 
Christinas and are down 15 percent the week before 
th& end of (.he year and IT percent the week after 
the end of the year, and are 12 percent above the 
last day of the year. It is things like this that 
bother me when we say that bed supply determines 
use. I am not completely sure what this means, 
because wo seem to be short of beds on Thursday 
during the fourth through the seventh week of the. 
year but never at any other time. And all of this 
c.yclicity which is the world in which we live 
has to come into what we mean by use and struc- 
ture of beds and the way wo analyze data, It, 
seems to me that if you tell mo the kind of occu- 
pancy you want, I will check the days of the year 
and give it to you. 

This information also relates to the charac- 
teristics of the patients who happen to be in the 
hospital, If you want t o find out how many do not 
need to ho there at a particular time, you tell me 
what level you want and I will find out the date 
during the year when they probably will be in 
there. If you also want to find out what day of 
the year everyone really needs to he in the hospital, 
then I will give you Christmas eve and we will 
have this nailed down. 

So, I am not completely sure where the eco- 
nomics fit in and where we should study. But we 
wanted to get it from the composite of the entire 
metropolitan area so that we did not have sample 
bounces and selection factors and, therefore, this 
is the way we are working. 



CLOSING REMARKS 



DK. HALDEMAN; 

On behalf of the Public Health Service and, 
I am sure, on behalf of the American Plospital As- 
sociation, I want to say that you have made this a 
most stimulating meeting, and I am really enthu- 
siastic about it. Again we should recognize that 
we all owe a debt of gratitude to George Bugbee, 
who did the real hard work, and to the very excel- 
lent staff work of the AHA on conference 
arrangements. 

I would like to ask one question. George 
and I have talked for a long time in terms of the 
importance of this general area of research and 
wo collaborated a year ago, as I think most of you 
know, on a preliminary conference of this type. 
We then felt that it would be desirable to follow 
it up with a more structured meeting bringing in 
more broader groups. 

I would like to get pome feeling from the 
group as to whether such a conference as this 
should be repeated and, if so, how soon a year, 2 
years? One of the great benefits of this meeting, 
it would seem to me, actually had to <lo with the 
progre?s reports on projects under way. Sec- 
ondly, T think that it was extremely helpful that 
so many of the people on (he program were de- 
scribing also things that did not work, and some 
of the things that yon had to look out for in using 
and interpreting statistics, which yon do not, ordin- 
arily get when you read the published reports. 

Therefore, I would like to have some com- 
ment on that. Would it be worth while to repeat, 
at some future date? 

THE CHAIRMAN: 

Are there any comments on this point? I 
think that you may, over a period of time, have 
thoughts about it and I think it \\ould be helpful 
if you would write to Dr. Haldeman about it. 

Mention has been made of the need for 
communication between those doing research. 
There are some such devices now that we are all 
familiar with, both in printed words and in gather- 
ings, but none of them seems to quite do the job 
that needs to be done. Granted that it r;jm never 
be completely accomplished; even so it would ap- 



pear that with more thought we might improve 
communication between those concerned with re- 
search in the hospital hospital having a very 
broad definition, as has been evident here. There- 
fore, if you do have comments, Dr. Haldeman and 
I would appreciate having them. 

Dr. McXinch, do you have any final words 
that you want to say? 

DR. McNINCH: 

I will make mine very brief, I will say 
Amen to what Dr. Haldeman lias said. 

THE CHAIRMAN: 

I will not try to sumimrize. Both Dr. Hal- 
deman and Dr. SIcNinchj representing the sponsor- 
ing organizations have been complimentary to me, 
out of proportion, I think I should say. In re- 
sponse, however, I think that I should soy that I 
am responsible for Ilia faults of this meeting to a 
degree, We set, the objective of examining oppor- 
tunities for further research and it w:is necessary 
to select people who would appear. As I look 
around at the talent in this audience and see how 
many there are who have not been on the program 
I mn conpcions of the fact that we have not tapped 
all of the talents by si long ways. My apologies 
for that to the degree that I am responsible, al- 
though, obviously, we have had good program 
content. 

I never have conceived that this meeting 
was really a meeting of researchers for examina- 
tion iu depth an exchange of ideas on specific 
projects. Our hope was that it would spark ideas 
and stimulate more research in the broad field of 
use, and I trust that, it does have some such effect. 
I think that in. trying to keep to that objective, 
several times the audience has missed the oppor- 
tunity for pursuing intriguing ideas that might 
have been presented in a somewhat differently 
structured conference. 

Nothing has been said about research appli- 
cations, and I think it is inappropriate to sny very 
much. Yon all know that there are a number of 
foundations interested in this field that we are 
talking about. "We know that there has been in- 
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creasing Federal money. Dr. White, EIS Chairman 
of 1 he, Study Section, has been asked for an opin- 
ion, I am a member of the Federal Hospital 
Council that reviews some of the applications. I 
think that Congress has been rather generous in its 
appropriations of money, and I think there is lati- 
tude for more well -structured research within the 
funds available, in not only methodology but also 
relative to projects. 

I could not help thinking, sis Paul Densen 
mentioned about the remarkable demonstrations 
that they were doing in New York City and the 
plans they have for careful evaluation, that there 
is money for demonstrations which evaluates both 
the hospital field and, I think, community facil- 
ities. This, of course, is not an easy research area 
there are not endless people qualified to do it and 
those who are qualified are pretty busy with 
projects. 



There is latitude for more attention and, I 
think, financial support for more effective research 
at a greater volume. I hope that may be one of 
the products of this conference. 

I don't think I could thank the speakers 
enough for the effort they have made and I par- 
ticularly feel indebted to Dr. Brotherston, who did 
such a remarkably fine job in giving us an over- 
view of the research in hospitals and medical care 
that has been going on in Great Britain. I also 
appreciated the comments of Dr. Davies, and it 
was pleasant having both of them here. I think 
all of these papers have been excellent they were 
not easy assignments for the speakers. I know 
that I express for all of you our appreciation of 
the efforts they have made. 

Thank you all for your attention and God- 
speed in getting home. (Applause) 

(The meeting was, at 8 : 25 p.m'., adjourned 
sine die.) 
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APPENDIX I 



Some Differences in the Usage of Hospitals in the 
United States and Great Britain* 



BY DR. S. L. MORRISOK AND PROFESSOR J. H. P. BROTHERSTO3ST 



The financial sources of published data on 
hospitalization in the United States and Britain 
are the health statistics compiled for the U.S. Na- 
tional Health Survey and the Hospital Inpatient 
Enquiry carried out by the Ministry of Health and 
the General Register Office. The American data 
were collected by interview for the sample house- 
hold in the National Health Survey, and provides 
information about patients discharged from short- 
stay hospitals (those in which most patients stay 
for less than 30 days) in the year July 1957-tTune 
1958. Such hospitals include 95 percent of all dis- 
charges. These data only include persons living 
at the time of the interview, and thus tend to 
underestimate the total number of discharges since 
the hospital experience of those dying in the year 
before the interview period is excluded. The 
British data arise from the completion, by vir- 
tually all hospitals (in 1959) in England and 
Wales, of a form for one patient in ten after that, 
patient has been discharged (or has died). The 
sampling method used ensures that there is no 
bias iu the selection of cases. 

Dr. R. E. L. Logan (1961) used these and 
other sources to make some interesting compari- 
sons between hospital usage in the IT.SA. and in 
Britain in his Milroy lectures. Logan showed 
that, while the number of beds for 1,000 popula- 
tion is very similar in the two countries, the ad- 
mission rate is approximately 60 percent higher in 



* Submitted by Dr. J. H. F. Brotbcrston as an appendix 
to Ills paper. 



the USA. (Table 1). It follows that the mean 
duration of stay in hospitals mnet IK lower in the 
U.S.A., and tables 2 and 3 illustrate this for cer- 
tain selected diagnoses. Table 2 shows that the 
average length of stay for surgical conditions is 
40 percent shorter in the United State?. 

A comparison of the length of f-tuy for med- 
ical cases is more difficult because many of the 
British patients are elderly and liiuo bwn dis- 
charged from (or died in) chronic disoji&e hos- 
pif als. To get around this difficulty, the length of 
stay in English teaching hospitals is compared 
with some North American figure. The teaching 
hospitals in England cater to a lower proportion 
of old people and have a markedly shorter average 
duration of stay than nonto:iching hospitals. 
Even PO, it is clear from the table tlmf the Ameri- 
can length of stay is not much more than half that 
of the English teaching hospital*?. 

"Why, then, should there be MH'h large dif- 
ferences in usage in the two countries ? Are these 
differences a reflection of the different methods of 
financing medical care' Table 4, comparing dis- 
charge rates for certain diagnose?, does tend to 
show that conditions treated mainly surgically 
show large differences iu discharge rates between 
the two countries, although there are exceptions. 

Table 5 illustrates an apparent difference in 
the social needs being met by Hospitals. This 
table suggests that admissions in England may be 
more influenced by social need than in the United 
States, i.e., the much higher ratio of unmarried to 
married in England may reflect a, policy of admit- 



131 



ting move patients because they have no one to 
look after them at home, rather than on purely 
clinical needs. Perhaps the higher proportion of 
such patients helps to explain the longer duration 
of stay in English hospitals- However, Peterson 
(196S) has pointed out that many diseases appear 
to have lower admission rates in Britain but higher 
case fatality rates, suggesting that "hospitalized 
British patients are almost certainly much sicker." 
It is difficult to reconcile this finding with the in- 
dications of "social need" admissions in Table 5. 
In fact, many of the inferences drawn in this 
appendix are based on very slender evidence ; a de- 
tailed study of differences between selected areas 
of the U.S.A. and Britain might lead to more use- 
ful conclusions. 

Table 1. A COMPARISON BETWEEN MEDICAL 

RESOURCES IN THE UNITED STATES AND ENG- 
LAND AND WALES 

(Adapted from Logan, 1961) 



Hospital 

beds per WOO 

population Admissions 

(excluding 

TB and 



United States. 
England and 
Wales 



mental) 
5.0 

5.4 



per 1,000 
popula- 
tion 

136 



Doctors 
per 10,000 
popula- 
tion 

14 



11 



Table 2. AVERAGE DURATION OF STAY (DATS) 
IN HOSPITAIJ FOR CERTAIN SURGICAL CONDI- 



TIONS 



(Adapted from Logan, 1961} 



Tonsils and Adenoids.- - 

Appendicitis 

iernia 

laemorrhoids 

Diseases of Gall Bladder 
J.1 Surgical 



United England 

States and Wales 

(a) (6) 

2 4 

7 11 
9 14 

8 13 
14 20 

7 



a) U.S. National Health Survey, 1958. 

b) Hospital Inpatient Enquiry for 1956-1957, 
1961. 

3) Forsyth and Logan, 1960, 



Table 3. AVERAGE DURATION or STAY (DAYS) 
IN HOSPITAL FOB CERTAIN MEDICAL CONDI- 
TIONS; INDIANA 1956, SASKATCHEWAN 1957, 
ENGLISH TEACHING HOSPITALS 1957 

(Adapted -from Logan, 1Q61) 

England 

Indiana Saskat- and Wales 

Blue chewan Teaching 

Cross (adjusted} Hospitals 

(a) (a) (6) 

659 



Influenza 

Pneumonia 

Bronchitis 

Vascular lesions 

CNS 

Ai'tcrioscl erotic 

heart disease 

(including 

coronary) 

Hypertensive heart 

disease 

All diagnoses. 



7 
11 

19 



18 

12 

7 



9 

7 

27 



20 

14 
10 



16 
20 

22 



26 

20 
15 



(a) Lerner, 1961. 

(b) Hospital Inpatient Enquiry for 1956-1957, 
1961. 



Table 4. DISCHARGE KATES FOII 1,000 POPULA- 
TION FOB SELECTED DIAGNOSES 



Total 

Diseases of skin 1. 2 

Appendicitis 2. 5 



United States (a) 

(Surgi- 
cally 
Treated) 



Peptic ulcer 

Hernia 

Allergic, endocrine, 

metabolic diseases- 
Upper respiratory 

conditions (mainly 

tonsils and 

adenoids) 

Hemorrhoids 

Diseases of gall 

bladder 



1.7 

2.7 

2.6 



7.3 
1.4 

2.5 



(0.7) 
(2.2) 
(0.6) 
(2.5) 

(0-6) 



(6.1) 
(1.3) 

(1.5) 



England 

and 
Wales (b) 

Total 

1.4 
2.8 
1.5 
2.3 



5.4 
0.6 

0.8 



(a) US. National Health Survey, 1958. 

(b) Hospital Inpatient Enquiry of 1958, 1961, 



Table 5. RATIOS OF DISCHARGE RATES* ACCORDING TO MABITAL STATUS 

(Ratios for married males and married females in each country and in each age group are given as 100.) 

United States (a) England and Wales (b) 



Males_ 


Married Single 
100 124 
100 59 

United Stales (a) 


Widowed or 
Divorced Mairied Single 

155 100 192 
102 100 148 

England and Wales 


Widowed or 
Divorced 

174 
130 

(W 


Females. 


Males 


Age 
45-64 

65+ 

45-64 
65+ 


Mamed 

100 
100 

100 
100 


Single 
124 
90 

59 
73 


Widowed or 

Divoiced Age 

155 45-64 
100 65-74 
75 + 
102 45-64 
90 65-74 
75 + 


Married 
100 
100 
100 
100 
100 
100 


Single 
192 
220 
281 

148 
160 
206 


Widowed or 
Divorced 

174 
164 
192 
130 
130 
147 


Females 





(a) U.S. National Health Survey (1958). 

(b) Abel-Smith and Titmus (1956). 

*The English figures relate to those patients in general hospitals on the day of the 1951 Census, 
and are therefore not directly comparable with the United States figures. 
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APPENDIX II 



Some Measurements in an Organized Health Service 

DR. R. J. PETERS 



This short paper deals with information 
tinly of a statistical character about the work 
the National Health Service in Great Britain, 
nance is not under consideration although some 
the information that is collected for purposes 
finance may be useful in this context. We are 
w concerning ourselves with the collection of 
ta for the purpose of measuring the amount of 
rk clone over the whole country, and in areas 
d districts. Thus, the subject is the informa- 
n that is collected as a matter of routine for 
rposes of administration, control and compari- 
i. A brief mention is also made of work and 
cieucy studies. 

Some sources of information about health 
listics before and during the National Health 
L'vice are listed, and also some references to 
rk study. 



wtine Information- 

Obviously, any organization that has an ad- 
listrative structure must collect data from the 
lower levels and arrange that such data be 
tably supplied to the top levels of management 
I direction. So ifc is with the health service 
ere, however, the routine information required 
in some respects, difficult to obtain on the basis 
ibsolute accuracy and consistency because of the 
ure of the service and the individual ability of 
component parts. 

ed by Dr. J, H. F. Brotlietston AB an appendix to 



Before the establishment of the National 
Health Service in 1948 statistical information 
about hospital and domiciliary medical care was so 
incomplete that a national or even an area picture 
could not be pieced together. The local author- 
ities presented a certain amount of information to 
the central government departments in the Annual 
Reports of the Medical Officers of Health and on 
a variety of forms which the health ministries re- 
quired them to fill up. Thus, the central govern- 
ment luiew about the number, the position and the 
work of local authority clinics for tuberculosis, 
venereal diseases, maternity and child welfare. 
They also knew something about the results of 
medical inspection of school children and their 
treatment at school clinics. They also knew the 
numbers of notifications of infectious diseases in 
each local authority area, the numbers of such 
cases that were treated in hospitals and sanatoria ; 
also, since 1929 local authorities were able to pro- 
vide a certain amount of information about pa- 
tients treated in their own general and maternity 
hospitals. The level of quality of accuracy of the 
information returned by local authorities varied 
widely. In some places interest was keen and con- 
sequently care was taken in the collection of the 
data. Where this was so the statistics could be 
regarded as reasonably reliable. In other areas 
preparation of routine returns was regarded as 
something of a chore, with conseqxtent decline in 
accuracy, Sometimes the forms themselves which 
the local authorities had to complete would become, 
through course of time, obsolete. Often local au- 
thorities were inclined to think that some of the 
forms they filled up had survived their usefulness 
and were merely pigeon-holed in the ministries. 



One of the morals of tins is that it is perhaps 
easier to start a routine form of enquiry than to 
end it. 

The voluntary hospitals were individual 
enterprises owing no duty to provide the ministries 
with statistics, each one only publishing what in- 
formation the Board of Governors or Managers 
thought necessary. Many of the bigger hospitals, 
however, in their annual reports published a fair 
amount of information about inpatients, admis- 
sions, discharges and deaths, the diagnostic cate- 
gories of the patients, surgical operations done 
and the work of special departments. 

On the whole the need for national informa- 
tion a'bo-ut the work of the health services as they 
existed then was not apparently strongly felt and 
there certainly was no burning desire among the 
authorities in general to do much towards produc- 
ing accurate primary statistical data or to do fur- 
ther work on the data after they had been obtained. 
One must conclude that a considerable amount of 
effort was wasted largely because interest seemed 
to be lost in the statistics as soon as they were sub- 
mitted or published, perhaps because of their al- 
leged, unreliability. Even now special surveys are 
often, of necessity set up to collect information, 
whereas the routine statistics ought to be good 
enough to provide an answer. 



Hospitals: Case Load and Occupancy 

What then is the kind of information 
thought to bo necessary on the national scale and 
has in fact been collected as a matter of routine? 
Taking first the hospitals, it is obvious that there 
should be reliable statistics of the numbers of ad- 
missions and discharges of patients, their age and 
sex distribution, their classification according to 
the kind of hospital accommodation they occupy, 
whether acute surgical beds, acute medical beds, 
obstetrical wards and so on. The average dura- 
tion of stay in days is also needed for patients in 
classifications such as medical, surgical, obstetric 
and so on, and ior the different kinds of hospitals 
and hospital departments. The number of new 
attendances and total attendances at the outpatient 
departments is required, also subdivided according 
to hospital department. All this data is in fact 
collected and published. The figures can be broken 
down, to show patients in geographical areas of 



residence, the type of hospital, and hospital 
department. 

Each hospital also provides data at fixed 
periods about the number of beds in the hospital, 
classified as the complete bed complement, staffed 
beds, unstaffed beds, and occupied beds. The hos- 
pitals themselves will work with these figures and 
derive from them and from censuses of patients in 
the hospital from time to time information such 
as the percentage occupancy of hospital beds in 
bed categories, the turnover of beds, the turnover 
interval between patients, and average length of 
stay of patients. Departmental hospital statistics 
are also provided by the hospitals about the usage 
of laboratory services, X-ray departments, the 
consumption of drug 1 ), dressings, and appliances. 
Hospitals, as a matter of course, also pro- 
vide statistics about the numbers and grades of 
staff medical, nursing, administrative, other pro- 
fessional and technical, domestic and maintenance. 
Some of tins or similar information is col- 
lected and presented in relation to financial re- 
turns. "Where this is so the figures should tally or 
should be reconcilable with information which is 
contained in the administrative forms or returns 
that Ha to to the functional activities of the hospi- 
tal inpatient care and the range of the hospital 
services. 

Costing returns are obtained from hospi- 
tals to permit analysis of weekly running oo^ts per 
patient bed by type of hospital, and broken down 
into sections for j-taff; wages and Clark's; drugs, 
dressings, and appliances ; catering and fiH*l ; heat- 
ing and lighting; housekeeping and maintenance. 
Analyses of eosts are now ftlo made functionally 
by departments, for example: wnul?, theatre?, 
X-ray departments, etc. 

It may be hiiid that all this information is 
primarily of an administrative character and, 
apart from the data relative to indn idual patients, 
contributes little to knowledge about the nature 
and quality of the services rendered. The data 
about bed occupancy can, however, tell something 
about the u^.ige of beds. From the returns of ad- 
missions, discharges, and waiting lists various 
averages can be calculated such as the average du- 
ration of stay per patient and the average turnover 
interval. From the waiting list figures a certain 
amount can be cautiously deduced about the pres- 
sure on hospital accommodation. 

The main vahie of all tliis information how- 
ever, is in enabling comparisons to be made inelic- 
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ative of change or progress year by yenr, It can 
show the gross change in the number of available 
staffed and occupied beds, the increase or decrease 
in the numbers of staff- of various grades, the 
changes in the average stay of patients in hospital, 
and the switch of demand from one type of hos- 
pital bed to another. The figures are also useful in 
comparing region with region and hospital with 
hospital. Even with the crude figures available 
enough may be extracted to warrant further and 
more detailed investigation on the spot to explain 
differences that are found between individual hos- 
pitals and the variations that occur in different 
geographic areas. 

There are, of course, reservations upon the 
acceptance of some of this information ; for exam- 
ple, the numbers on the waiting list for admission. 
It often happens that a patient is put on a hospital 
waiting list for some complaint that is not of an 
urgent character. Such a patient may go else- 
whore for treatment; he may die; he may decide 
to carry on without the treatment recommended; 
the condition for which treatment was recom- 
mended may resolve itself and hospital treatment 
may no longer be required. Sometimes the very 
act of placing a patient on a waiting list seems to 
interrupt communication between the patient and 
the hospital and between the patient and his own 
doctor for a very long time. 

Change in the number on a waiting list be- 
tween the beginning and the end of the year is 
taken sometimes as an indication of demand for 
hospital beds. This may lead to a fallacious con- 
clusion. There may, in fact, be no real increase 
in demand even if there is an increase in the wait- 
ing list. A detailed scrutiny of the individual 
cases on the list is necessary before valid con- 
clusions can be drawn. Furthermore, an increase 
in the waiting list or indeed a large waiting list in 
itself, may be better interpreted as a need for bet- 
ter administration and better deployment of staff 
and resources than as a need for more accommoda- 
tion. A waiting list for routine operations of 
"cold" surgery can be wiped out by running addi- 
tional sessions or bringing into use unoccupied beds 
perhaps in another hospital, or rearranging the 
disposition of beds between specialties. To do this 
indeed may cost money for additional staff, tem- 
porarily perhaps, and this may be the obstacle. 
The waiting list may thus be a challenge to the 
administration and a problem of finance rather 
than a demand for new building. 



Care must also be taken in interpreting out- 
patient figures. High outpatient figures may rep- 
resent a transfer of responsibility and work from 
general practitioner to hospital, or, on the other 
hand the outpatient department may be doing 
work that in other hospitals is done in the in- 
patient wards. Minor casualties and emergencies 
are often included, and one patient might on one 
day be counted several times if he visits different 
units of the outpatient department in the course 
of his diagnosis and treatment. 

Staff enumeration also presents difficulties, 
Figures are usually presented in the tables in terms 
of whole-time staff, but many of our hospital medi- 
cal and nursing staffs are part-time, and the deci- 
sion as to how many of them are the equivalent of 
one whole-time staff member is rather an arbitrary 
one. Consultants who are largely part-time are 
paid according i o the number of notional half-day 
sessions they attend in tho week. It is difficult to 
present in terms of wliolo-time staff the number, 
say, of consultant surgeons in tho hospital service 
in truly realistic figures, for many give more than 
their covenanted amount of work and, no doubt, 
some give less. Consultant cover may mean differ- 
ent things in terms of work for different people in 
differing hospital situations. 



General Medical Services 

On the general medical services, that is, the 
family doctor service given by the general medical 
practitioner, statistical information is obtained 
from the Executive Councils. Returns are pre- 
pared by them as a routine of the numbers of doc- 
tors in practice in their urea, whether singly or in 
partnership; their geographical distribution; the 
numbers of patients on their lists; the number of 
prescriptions issued by doctors and hence the fre- 
quency of prescriptions per person on their lists. 

Data are also obtained about dental treat- 
ment under the National Health Service ; numbers 
of dentists participating; numbers of coiirses of 
treatment; dentures supplied and other relative 
information ; and the amount of treatment given to 
the so-called priority classes young children, ex- 
pectant mothers, and adolescents. 
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From the ophthalmic service there come 
data on the amount of sight-testing done and the 
provision of spectacles. 

Information on sickness in the working pop- 
ulation and its trends is obtained from the sick- 
ness certificates the general medical practitioner 
issues to insured employed persons. This material 
is tabulated and processed by the Ministry of Pen- 
sions and National Insurance. The Ministry 
publishes fairly elaborate annual statistical tables 
giving an analysis by age, sex, regional distribu- 
tion, monthly occurrence, and diagnosis of cases 
certified us unfit for work by reason of sickness or 
accident. While these statistics suffer, perhaps in 
greater degree, from the same kind of defects of 
inaccuracy that apply to death certification, they 
do give a broad indication of the types of illness 
from which the working population of this country 
suffer from time to time, and which result in ab- 
sence from work. When examined in suitable 
groupings of the diagnostic classification these 
figures can be very useful even though the accuracy 
of the individual classifications may be called in 
question. 



Local Health Authorities 

The local health authorities, through the 
Medical Officers of Health, provide the ministries 
with routine statistics in a set form relating to 
their functions under the National Health Services 
Act, much on the same lines as they did before 
the number of clinics and attendances; the number 
of health visitors, district nurses, midwives, and 
the visits they make ; and possibly some classified 
description of these visits. They also supply in- 
formation about the "home help" service and the 
kind of cases or families which arc given this 
service. Details of preventive medical measures 
are also supplied as a routine the number of im- 
munisations and vaccinations. The local author- 
ities also report on the work done by the domi- 
ciliary midwifery service. Medical Officers of 
Health also prepare statistics on births, infant and 
maternal mortality, and other matters such as 
school health and environmental health which are 
not functions within the National Health Service 
but are closely associated. 

712-881 063 10 



Hospital Morbidity 

Ever since the inception of the National 
Health Service the need has been felt for inf orma- 
tion that would show what the hospitals were 
doing in the way of providing medical care, not 
merely how the hospitals were run and what they 
cost. One wants to know who 'the patients are, 
their age and sex distribution, where they come 
from, who sent them to hospital, what was wrong 
with them, what treatment was given and what 
was the result. While general figures are useful 
from the administrative and financial point of view 
the main preoccupation of the hospitals is in- 
escapably the treatment of disease and accidents 
and it is therefore highly important that as much 
as possible should be known about what they do in 
tliis respect. To obtain useful inpatient morbidity 
statistics on a nationwide basis has been difficult. 
A system has been building up in England for 
many years but only within the past two or three 
years has anything like complete cover been 
achieved. In Scotland a scheme has been put into 
effect but nothing has so far been published. 
Some individual hospitals have, however, made 
yearly analyses and have published tables show- 
ing the kind of cases they treat and \\hat they do 
for them. Some Regional Boards also have mor- 
bidity recording schemes, and special studies in 
collecting and tabulating of routine statistics have 
len carried out by the Nuffield Provincial Hos- 
pitals Trust. The general principles of morbidity 
recording for the purpose of providing si general 
picture of the kind of work the ho-pitals are doing 
are by now pretty ^sell established. 



Essential Data on Hospital-Treated Morbidity 

Essential or basic data are identification 
particulars of the patient : his age, sex, civil status, 
residence, occupation, date of -admission and dis- 
charge; how he came to be admitted through his 
general medical practitioner or otherwise; the 
final diagnosis of the disease for which ha was 
treated and any associated or underlying morbid 
condition; classification of any operation per- 
formed; and date and particulars of discharge or 
death. Additional questions must be asked and 
variations introduced for obstetrical cases and for 
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infants bom in hospitals. A slightly different 
form of enquiry is also used for mental hospitals. 

Generally speaking, in this type of statis- 
tical exercise the amount of information to be 
transferred from the record card to the statistical 
card should be kept to a minimum, and readily 
picked out from the patient's case record which 
should be designed so as to permit of this. The 
extracted information is punched on statistical 
cards and national, regional, and individual hos- 
pital tables are constructed. 

Questions now arise: Is this information 
adequate? Should it be extended and improved? 
There are limitations to the uses to which such 
routine statistics of this kind can be applied, yet 
the practical difficulties of extending the scheme 
are great. In assembling these statistics on a 
nationwide scale the importance of promptness in 
return must be emphasized, but there is a lot of 
work to be clone in verification as well and this 
causes delay even in a simple enquiry. After proc- 
essing of the data a great deal of further statis- 
tical work is required to get the most out of the 
figures, and to rationalize the presentation of the 
final tables, and finally to deduce conclusions. In- 
consistencies from year to year must be watched. 
Individual hospital units and Regional Boards 
should use these figures as the basis of further re- 
search and investigation, along with such other in- 
formation as they may find it desirable or possible 
to obtain. The Oxford Regional Hospital Board, 
for example, has done a great deal in this way. 
New Regional Hospital Boards publish annual re- 
ports of considerable interest, but it would be a 
good thing if all such reports could be constructed 
under a common framework of order and content 
that would apply throughout the United Kingdom. 

In order to be fully exploited as useful in- 
formation, all health statistics should be published 
promptly. Routine statistics that are 3 or 4 years 
old are, in effect, obsolete, except for comparison 
with previous years, and decisions based on them 
may be misleading. The routine administrative 
and financial information may, under pressure, be 
made available in good time, but morbidity statis- 
tics present some difficulty mainly because of the 
lack of incentive and interest on the part of the 
medical staff and the frequent changes of house 
officers to whom the work is, unfortunately, often 
left. Slackness in collection and processing can 
easily lead to a situation, which can be observed in 
many countries, where these statistics are some 
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years old before publication. Constant pressure is 
therefore needed to keep them up to date. 



The Inpatient Enquiry 

In England the hospital inpatient enquiry 
is earned on by the Ministry of Health and the 
General Register Office. Forms are filled up from 
information extracted from the records of a 10 
percent sample of all discharges from National 
Health Service hospitals in England and Wales, 
other than psychiatric hospitals. Coverage has 
been virtually complete since 1958. Tables are 
produced showing the total numbers of discharges 
and deaths as calculated from the sample in diag- 
nostic groups derived from the international 
classification. Tables are also given showing the 
discharges and deaths included in the enquiry by 
disease, in regions year by year since 19(57. Mean 
duration of stay spell of hospital treatment is 
given for selected diseases. An analysis of ma- 
ternity cases is given in hospital regions accord- 
ing to type of maternity care given. 

This represents the kind of information 
published annually by the General Register Office 
and the Ministry of Health in the Reports on Hos- 
pital Inpatient Enquiry, The first part of each 
report is a preliminary set of tables published 
early. The second part of the Report comes later, 
is much bulkier, and contains the complete analy- 
sis. The value of these reports should be obvious, 
and it is hoped that they will be continued and 
that the standard of the reporting will get better 
and better. The usefulness of the system however, 
must be kept continuously under review and with 
experience it may be found that the procedure 
can be simplified and the amount of work entailed 
reduced. But meantime the plan should be to let 
the system run for a number of years. These re- 
ports need to be adequately studied and made use 
of both for the information the reports themselves 
provide and as a starting point for other surveys 
and enquiries. Otherwise they run the risk of 
being in time only supei'ficially examined and rele- 
gated to the pigeonhole. 

The system of morbidity recording that has 
been described does not mean that all other en- 
quiries become unnecessary. For instance, there 
already exists a cancer recording system. The 
intention here is to register all cases of cancer, to 



make a full record of clinical and pathological 
data of treatment, by surgery, radiotherapy or 
any other method, and to follow them up system- 
atically each year over a number of years. From 
these data survival rates can be calculated for 
different types of cancer according to the treat- 
ment received, as well as for cases where no treat- 
ment has been given. The success of this system 
varies from region to region ; in some, registration 
and follow-up is almost complete and special re- 
ports are prepared arid circulated showing the 
results as survival rates year by year. 

The recording of tuberculosis cases is an- 
other example of a system applicable to a special 
disease where the social implications have been 
and still are of vital importance. Venereal dis- 
ease reports from clinics may be quoted as an- 
other example, and they are valuable, although 
cases treated by consultants and general practi- 
tioners privately are not included. 



DISCUSSION 

Some statisticians and clinicians generally 
are not over-enthusiastic about this kind of statis- 
tical exercise. Morbidity statistics tend to IMS slow 
in appearing and this is a point tho-^e in charge 
must have in mind ; gradually, however, the figures 
are being made available more punctually. It 
should be accepted as a maxim that where returns 
of any kind 'are received from a section of the 
health service they should be processed and fed 
back to those who originally supplied them, so that 
they may feel that their work has not been wasted. 
Additional arithmetic has to be done with all 
these figures in order to relate them to the various 
denominators of population national, regional, 
and local in order to obtain rates. 

At regional level the figures offer oppor- 
tunities for comparison between the regional and 
the national averages and also enable comparisons 
to be made between different hospitals. 

"When a system is complete the tabulations 
offer an opportunity for studying trends from year 
to year and these, studied intelligently in conjunc- 
tion with the known trends and developments in 
medical science, may be of assistance in estimating, 
even if not in predicting, the needs for hospital 
provision in the future. 



I-Iospital consultants when considering a 
system of this kind tend to assume or even insist 
that it can be of use for medical research purposes 
in their own specialty. Obviously, any form of 
enquiry or schedule of information designed for 
serious research purposes on a clinical subject must 
be specially drawn for that purpose and, indeed, 
ad hoc for a research project which has been defi- 
nitely planned. The system however, could be 
used as a means of identifying the records of 
patients suffering from any particular disease in a 
hospital area or throughout the country, and also 
for directing attention to problems requiz'ing re- 
search. In other words, it might be possible to 
enumerate and locate all cases of a particular 
classification that had been treated in hospitals so 
that their records could be extracted and subjected 
to further examination. 



Work Study 

"Work study, efficiency engineering, or time 
and motion study (or whatever variant or 
synonym may bo used) is mainly concerned with 
the investigation of manual operations in work 
situation in f actories, hospitals, or elsewhere. The 
purpose is to derive from systematic observations 
the best methods in terms of economy of effort and 
time, of carrying out particular operations and to 
solve specific questions in planning and design. 
The methods employed include time and motion 
study, the analysis of movement, and the effects of 
work techniques on quality and on the performance 
of the personnel. Time and motion studies are 
made employing well-established techniques. Di- 
rect observation records are made of staff on the 
premises and movements at the bench. For the 
recording of movements from point to point with- 
in the premises, the amount of traffic between vari- 
ous compartments and the time spent in these, 
devices such as string diagrams and stop-watch 
records of timing are "used. In particular the 
string-diagram technique has been widely used 
in attempting to assess the suitability of the design 
of different kinds of wards and the layout of their 
annexes for the nursing of patients. The Kumeld 
Provincial Hospitals Trust have carried out many 
investigations of this kind, not only in hospital 
wards but in operating theatres, laboratories, and 
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Isewhere. The actual study of time and motion in 
Bnch-work situations has perhaps more applica- 
>ility to industry, but there are many activities 
n the hospital service where such studies are of 



"Work study in hospitals is applied also in 
checking the efficiency of X-ray departments, lab- 
>ratories, catering departments, laundries, stores, 
jharmacy, in examining the efficiency of com- 
nunications and, of course, in administrative and 
>ffice work. 

Another term used in this connection is 
Drganization and Methods (0. andM.) which, al- 
Jiough it may cover much the same ground is, in 
sssence, tha application of work study procedures 
.owards increasing efficiency in office and admin- 
strative work, 

Detailed movement study springs histor- 
cally from the work of the GHlbreths (1911) and 
ithers. Modern work study methods are ade- 
quately presented in the books by Curry, R.M. 
[1960),Nadler,G. (1965) and Shaw, Anne (1960). 
The indiistrial Operations Unit of the Depart- 
nent of Scientific and Industrial Research is also 
leeply interested in studying and fostering meth- 
)ds of work study and they have issued some use- 
hil information on the subject. All these works 
five a good introduction to the methods, procedure, 
tnalysis by tabulation and diagrams, and presenta- 
ioii of the results, Modern methods of observa- 
ion and recording are discussed at considerable 
ength by Shaw and they include photography and 
line-photography in recording paths of movement, 
! or example, movements of the hands in the bench 
iperations, Shaw also deals with the training and 
unployment of work study personnel and carries 
he matter further into more psychological areas, 
l or example, incentives for employes. 

Personnel trained in work study methods are 
LOW employed in the Health Service at central 
government level and in all levels of the hospital 
ervice. At the hospital level it is not necessary 
terhaps to have in each hospital or hospital group 
, whole-time motion study expert. It is probably 
letter to arrange for the training of representative 
ersonnel in work study methods and for them to 
pread the gospel, For example, one of the senior 
lursing staff might be so trained and make it a 
>art of her duty to test and apply the principles 
phere she can, or to make suggestions for special- 
3ed work study enquiry into situations where im- 
provements in methods seem possible. 
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APPENDIX II. SOURCES 

Source of Information Prior to National 
Health Service 

1, Prior to the National Health Service informa- 
tion generally as regards the hospital services was 
not very complete. Mention might be made of the 
HOSPITALS YEAR BOOK, first published in 
1889, which mainly gave information about the 
voluntary hospitals. During the war, surveys of 
the hospital services were made throughout the 
country, in England by the Ministry of Health in 
association with the Nuffield Provincial Hospitals 
Trust, and in Scotland by the Department of 
Health. These surveys were carried out by med- 
ical surveyors who went over the whole field, re- 
gion by region and hospital by hospital. Annual 
Reports of the Health Departments gave informa- 
tion about the services administered by local au- 
thorities and, to some extent, some information 
about the services of general practitioners under 
the National Health Insurance Act. A special 
survey of the health services was made in 1937 in- 
dependently by P.E.P. (Political and Economic 
Planning) . 

2, ANNUAL REPORTS, Ministry of Health. 

3, The four surveys quoted below present the most 
complete picture of the provision of hospital facil- 
ities as they were available before the appointed 
day for the inauguration of the National Health 
Service. The war-time surveys also give the sur- 
veyors' ideas as to the extent to which hospital 
services should be provided according to the light 
of the times. This makes interesting comparison 
with present-day statistics. 

Department of Health for Scotland, SCOTTISH 
HOSPITALS SURVEY 1946. H.M.S.O. 
Gray, A.M. and Topping, A. HOSPITAL 
SERVICES OF LONDON AND THE SUR- 
ROUNDING AREA. London: H.M.S.O. 1946, 
(And similar surveys for each of the other English 
regions) . 

P.E.P. REPORT OF THE BRITISH HEALTH 
SERVICES. 1937. 

Department of Health for Scotland, REPORT 
OF THE SCOTTISH HEALTH SERVICES. 
H.M.S.O. 1936 



Routine Information on the Health Services 
at Present 

1. ANNUAL REPORTS 

Ministry of Health and the Department of Health 

for Scotland (now Scottish Home and Health 

Department) . 

Board of Control in England and the General 

Board of Control in Scotland on Mental Hospital 

Provision. 

Registrar General England and Wales* 

Registrar General Scotland* 

2. Department of Health for Scotland. HOS- 
PITAL COSTING RETURNS (Annually). 
H.M.S.O. 

3 Ministry of Health Statistics Branch. DI- 
GEST OF HEALTH SERVICE STATIS- 
TICS, Series A. No. 6. December 1961. (Mimeo- 
graph document.) 

This gives an extensive summary of the 
hospital accommodation available in regions, in 
hospitals and in hospital departments. In all there 
are 96 tables covering most of the routine informa- 
tion that is supplied from hospital boards and the 
teaching hospitals, including number of beds 
staffed, available and occupied, duration of stay, 
number of discharges or deaths; waiting lists, out- 
patient statistics analysed by department; staff 
statistics in medical and non-medical grades. Sta- 
tistics are also included about local health and 
welfare services and about the general medical and 
dental services. Much of this is included in the 
Animal Reports of the Ministry of Health. 

4. Ministry of Health and General Register Office. 
REPORT ON HOSPITAL IN-PATIENT EN- 
QUIRY FOR THE YEAR 1960: Part I, Pre- 
liminary Tables. Part II, 1962, Detailed Tables 
and Commentary. (Awaiting publication.) 

5. Ministry of Health. HOSPITAL COSTING 
RETURNS 1961. Parts I, II & III. H.M.S.O. 
These three volumes gives much information about 
the expenditure hospitals, costed up in depart- 
ments and units of service. 

6. Oxford Regional Hospital Board and United 
Oxford Hospitals. STUDIES ON THE HOS- 
PITAL IN-PATIENT ENQUIRY REPORTS 



*These are Included because they provide the necessary 
population and mortality background statistics. 



1 to 10. Oxford : Records and Statistical Depart 

ment 1960. 

The above are examples of the further USE 
made of statistics produced in the Hospital In- 
patient Enquiry Reports. 

7. Benjamin, B. and Perkins, T. A. MEASURE- 
MENT OF BED USE AND DEMAND. Hos- 
pital, 51, 1. pp. 31-33. 1961. 
This article gives a succinct statement of the way 
in which current statistics can bo applied to meas- 
urement of bed usage. 

8. Nuffield Provincial Hospital Trust. HOSPI- 
TAL AND COMMUNITY. Studies carried out 
by Ferguson T. & MacPhoil, A, N. in Ayrshire 
and Stirlingshire. Oxford University Press. 1954-. 
A study of inpatient morbidity. 

9. REPORT OF THE COMMITTEE OF EN- 
QUIRY INTO THE COST OF THE NA- 
TIONAL HEALTH SERVICE. (Guiilebaud 
Report,.) London : H.S.M.O, 1956. Appendix 5: 
Hospital Statistics: Contains a summary of avail- 
able and occupied beds, turnover, number of cases 
treated, inpatient and outpatient. Number of 
consultants from 1949 to 1954. This is taken as 
evidence of the increase in the amount of work, 
but by themselves such figures are not very useful 
as a measure of progress or otherwise. The Guil- 
lebaud Committee recommended the establish- 
ment of special research and statistics departments 
and operational research, including \sork on 
routine statistics of hospital occupancy and 
morbidity. 

10. SCOTTISH HEALTH STATISTICS pub- 
lished annually since 1958 by the Scottish Homo 
and Health Department. 

Each volume is in 18 sections and deals with vital 
statistics, infectious diseases, maternity services, 
infant and child health, general medical services 
and the hospital and specialist services. There 
are sections also on mental health and analyses of 
the cost of the health services. Altogether, this 
publication is entirely composed of statistical 
tables. Runs to nearly 200 pages of statistical in- 
formation. 

11. HOSPITAL BED OCCUPANCY, a report of 
the first study group set up by the Administrative 
Staff College in 1951 

Deals with the calculation of bed occupancy, turn- 
over of patients, length of stay, turnover interval. 
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-k Study 

'apartment of Scientific and Industrial Re- 
ch, INDUSTRIAL OPERATIONS UNIT. 
3 unit defines the industrial engineering as the 
lication. of the scientific method of manage- 
t and administrative problems in any corporate 
rprise that deals with people as well as 
hines, materials, methods and procedures or 
ems. 

rie, K. M. WORK STUDY. London. 1960. 
printed 1961). 



Nadlor, Gerald. MOTION AND TIME STUDY. 
New York: McGraw-Hill Book Co. 1955. 

Nuffield Provincial Hospitals Trust. WORK OF 
NURSES IN HOSPITAL WARDS. Report of 
a job-analysis. London. 1953. 

Nuffield Provincial Hospitals Trust. STUDIES 
IN FUNCTIONS AND DESIGN OF HOSPI- 
TALS. London. 1960. 

Shaw, Anne. WORK STUDY. London: Co- 
lumbia. 1960. 

Taylor, F. W. SCIENTIFIC MANAGEMENT. 
London: Harper. 194:7. 
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